2023-09-28T00:02:05.346 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T00:02:05.346 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488 --verbose --owner scheduled_yuriw@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} -- /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/orig.config.yaml 2023-09-28T00:02:05.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T00:02:05.470 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488 branch: wip-yuri-testing-2023-09-27-0906-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} email: yweinste@redhat.com first_in_suite: false job_id: '7403488' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-09-27-0906-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-09-27-0906-quincy sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3538 sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri-testing-2023-09-27-0906-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH4KRPMJ/Sk11MpERihoceOIMKd4jJGx5Zrw9gESv7h2FwvJXafyFdjEIm3gt4mUYefLPc96cVEPeidgoBgp8jQ= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGW6u61Bh3ClTs4VvujUDiEZq5QElDHaQmn5MJvzH/yWLqQwnjmzlUGNqnIrNpzXPhIntHN3gcG0zope9vy8rY8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - workunit: clients: all: - fs/quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-27_19:23:53 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-28T00:02:05.471 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa; will attempt to use it 2023-09-28T00:02:05.472 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks 2023-09-28T00:02:05.472 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-28T00:02:05.474 INFO:teuthology.task.internal:Checking packages... 2023-09-28T00:02:05.496 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28' 2023-09-28T00:02:05.497 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-28T00:02:05.497 INFO:teuthology.packaging:ref: None 2023-09-28T00:02:05.497 INFO:teuthology.packaging:tag: None 2023-09-28T00:02:05.497 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-09-27-0906-quincy 2023-09-28T00:02:05.497 INFO:teuthology.packaging:sha1: 471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:02:05.497 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-09-27-0906-quincy 2023-09-28T00:02:05.636 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1161.g471b6dfd 2023-09-28T00:02:05.636 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-28T00:02:05.708 INFO:teuthology.task.internal:no buildpackages task found 2023-09-28T00:02:05.708 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-28T00:02:05.718 INFO:teuthology.task.internal:Saving configuration 2023-09-28T00:02:05.735 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-28T00:02:05.748 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T00:02:05.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:57:08.713793', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH4KRPMJ/Sk11MpERihoceOIMKd4jJGx5Zrw9gESv7h2FwvJXafyFdjEIm3gt4mUYefLPc96cVEPeidgoBgp8jQ='} 2023-09-28T00:02:05.798 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:57:08.715780', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGW6u61Bh3ClTs4VvujUDiEZq5QElDHaQmn5MJvzH/yWLqQwnjmzlUGNqnIrNpzXPhIntHN3gcG0zope9vy8rY8='} 2023-09-28T00:02:05.798 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-28T00:02:05.819 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-09-28T00:02:05.819 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-09-28T00:02:05.819 INFO:teuthology.run_tasks:Running task console_log... 2023-09-28T00:02:05.889 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc4580e2b80>, signals=[15]) 2023-09-28T00:02:05.889 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-28T00:02:05.917 INFO:teuthology.task.internal:Opening connections... 2023-09-28T00:02:05.918 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:02:05.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:02:05.985 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:02:05.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:02:06.051 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-28T00:02:06.086 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-09-28T00:02:06.104 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-09-28T00:02:06.105 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-09-28T00:02:06.161 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T00:02:06.161 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T00:02:06.161 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.4" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:02:06.162 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T00:02:06.163 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T00:02:06.163 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T00:02:06.163 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T00:02:06.163 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-09-28T00:02:06.195 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2023-09-28T00:02:06.213 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2023-09-28T00:02:06.214 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2023-09-28T00:02:06.269 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Red Hat Enterprise Linux" 2023-09-28T00:02:06.270 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="8.4 (Ootpa)" 2023-09-28T00:02:06.270 INFO:teuthology.orchestra.run.smithi190.stdout:ID="rhel" 2023-09-28T00:02:06.270 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE="fedora" 2023-09-28T00:02:06.270 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="8.4" 2023-09-28T00:02:06.270 INFO:teuthology.orchestra.run.smithi190.stdout:PLATFORM_ID="platform:el8" 2023-09-28T00:02:06.270 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-09-28T00:02:06.270 INFO:teuthology.orchestra.run.smithi190.stdout:ANSI_COLOR="0;31" 2023-09-28T00:02:06.270 INFO:teuthology.orchestra.run.smithi190.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-09-28T00:02:06.270 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.redhat.com/" 2023-09-28T00:02:06.271 INFO:teuthology.orchestra.run.smithi190.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-28T00:02:06.271 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T00:02:06.271 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:02:06.271 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T00:02:06.271 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-09-28T00:02:06.271 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-28T00:02:06.271 INFO:teuthology.orchestra.run.smithi190.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-09-28T00:02:06.271 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2023-09-28T00:02:06.303 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-28T00:02:06.314 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-28T00:02:06.341 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-28T00:02:06.341 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2023-09-28T00:02:06.344 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2023-09-28T00:02:06.359 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-28T00:02:06.367 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-28T00:02:06.367 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2023-09-28T00:02:06.401 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2023-09-28T00:02:06.415 INFO:teuthology.orchestra.run.smithi026.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-09-28T00:02:06.416 INFO:teuthology.orchestra.run.smithi190.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-09-28T00:02:06.417 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-28T00:02:06.486 INFO:teuthology.run_tasks:Running task kernel... 2023-09-28T00:02:06.512 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-09-28T00:02:06.513 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-09-28T00:02:06.513 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-09-28T00:02:06.513 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-28T00:02:06.514 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-28T00:02:06.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:02:06.530 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-09-28T00:02:06.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:02:06.531 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-09-28T00:02:06.587 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-09-28T00:02:06.587 INFO:teuthology.task.kernel:Running kernel on smithi026: 4.18.0-305.25.1.el8_4.x86_64 2023-09-28T00:02:06.587 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2023-09-28T00:02:06.588 INFO:teuthology.orchestra.run.smithi190.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-09-28T00:02:06.589 INFO:teuthology.task.kernel:Running kernel on smithi190: 4.18.0-305.25.1.el8_4.x86_64 2023-09-28T00:02:06.589 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum install -y kernel 2023-09-28T00:02:07.985 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-09-28T00:02:07.985 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-09-28T00:02:08.064 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-09-28T00:02:08.064 INFO:teuthology.orchestra.run.smithi190.stdout:Unable to read consumer identity 2023-09-28T00:02:09.395 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 37 kB/s | 3.5 kB 00:00 2023-09-28T00:02:09.555 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-09-28T00:02:10.076 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 33 MB/s | 16 MB 00:00 2023-09-28T00:02:10.338 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-09-28T00:02:13.365 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-09-28T00:02:13.885 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-09-28T00:02:14.072 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-09-28T00:02:14.072 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-09-28T00:02:14.072 INFO:teuthology.orchestra.run.smithi190.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-09-28T00:02:14.224 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-09-28T00:02:14.225 INFO:teuthology.orchestra.run.smithi190.stdout:Nothing to do. 2023-09-28T00:02:14.225 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-09-28T00:02:14.328 DEBUG:teuthology.orchestra.run.smithi190:> echo no | sudo yum reinstall kernel || true 2023-09-28T00:02:14.666 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-09-28T00:02:14.667 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-09-28T00:02:14.667 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-09-28T00:02:14.673 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-09-28T00:02:14.673 INFO:teuthology.orchestra.run.smithi190.stdout:Unable to read consumer identity 2023-09-28T00:02:14.838 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-09-28T00:02:14.839 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2023-09-28T00:02:14.840 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-09-28T00:02:14.953 DEBUG:teuthology.orchestra.run.smithi026:> echo no | sudo yum reinstall kernel || true 2023-09-28T00:02:14.963 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:00:01 ago on Thu 28 Sep 2023 12:02:13 AM UTC. 2023-09-28T00:02:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-09-28T00:02:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T00:02:15.094 INFO:teuthology.orchestra.run.smithi190.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T00:02:15.121 INFO:teuthology.orchestra.run.smithi190.stderr:Error: No packages marked for reinstall. 2023-09-28T00:02:15.172 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum reinstall -y kernel || true 2023-09-28T00:02:15.323 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-09-28T00:02:15.323 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-09-28T00:02:15.514 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-09-28T00:02:15.514 INFO:teuthology.orchestra.run.smithi190.stdout:Unable to read consumer identity 2023-09-28T00:02:15.634 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:02 ago on Thu 28 Sep 2023 12:02:13 AM UTC. 2023-09-28T00:02:15.768 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-09-28T00:02:15.768 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T00:02:15.768 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T00:02:15.793 INFO:teuthology.orchestra.run.smithi026.stderr:Error: No packages marked for reinstall. 2023-09-28T00:02:15.802 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:00:02 ago on Thu 28 Sep 2023 12:02:13 AM UTC. 2023-09-28T00:02:15.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum reinstall -y kernel || true 2023-09-28T00:02:15.943 INFO:teuthology.orchestra.run.smithi190.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-09-28T00:02:15.943 INFO:teuthology.orchestra.run.smithi190.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T00:02:15.943 INFO:teuthology.orchestra.run.smithi190.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T00:02:15.950 INFO:teuthology.orchestra.run.smithi190.stderr:Error: No packages marked for reinstall. 2023-09-28T00:02:16.000 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2023-09-28T00:02:16.125 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.125 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.126 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.126 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-28T00:02:16.126 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-28T00:02:16.126 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-09-28T00:02:16.126 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2023-09-28T00:02:16.127 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q kernel | sort -rV | head -n 1 2023-09-28T00:02:16.207 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-09-28T00:02:16.208 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-09-28T00:02:16.251 INFO:teuthology.orchestra.run.smithi190.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.251 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.252 DEBUG:teuthology.orchestra.run.smithi190:> sudo rpm -qi grub2-tools 2023-09-28T00:02:16.278 INFO:teuthology.orchestra.run.smithi190.stdout:Name : grub2-tools 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:Epoch : 1 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:Version : 2.02 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:Release : 99.el8_4.1 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: x86_64 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:Group : System Environment/Base 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:Size : 9264631 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:License : GPLv3+ 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-09-28T00:02:16.279 INFO:teuthology.orchestra.run.smithi190.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:Relocations : (not relocatable) 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:Packager : Red Hat, Inc. 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:Vendor : Red Hat, Inc. 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:Summary : Support tools for GRUB. 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:Description : 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-28T00:02:16.280 INFO:teuthology.orchestra.run.smithi190.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-28T00:02:16.281 INFO:teuthology.orchestra.run.smithi190.stdout:hardware devices. 2023-09-28T00:02:16.281 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:02:16.281 INFO:teuthology.orchestra.run.smithi190.stdout:This subpackage provides tools for support of all platforms. 2023-09-28T00:02:16.281 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-28T00:02:16.282 INFO:teuthology.task.kernel:Updating grub on smithi190 to boot 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.282 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-28T00:02:16.503 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:03 ago on Thu 28 Sep 2023 12:02:13 AM UTC. 2023-09-28T00:02:16.642 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-09-28T00:02:16.642 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T00:02:16.643 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-09-28T00:02:16.653 INFO:teuthology.orchestra.run.smithi026.stderr:Error: No packages marked for reinstall. 2023-09-28T00:02:16.704 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2023-09-28T00:02:16.835 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.835 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.835 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.835 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-28T00:02:16.835 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-28T00:02:16.836 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-09-28T00:02:16.836 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=None, version=distro) 2023-09-28T00:02:16.836 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2023-09-28T00:02:16.967 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.967 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.967 DEBUG:teuthology.orchestra.run.smithi026:> sudo rpm -qi grub2-tools 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:Name : grub2-tools 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:Epoch : 1 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:Version : 2.02 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:Release : 99.el8_4.1 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: x86_64 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:Group : System Environment/Base 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:Size : 9264631 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:License : GPLv3+ 2023-09-28T00:02:16.996 INFO:teuthology.orchestra.run.smithi026.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:Relocations : (not relocatable) 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:Packager : Red Hat, Inc. 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:Vendor : Red Hat, Inc. 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:Summary : Support tools for GRUB. 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:Description : 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-28T00:02:16.997 INFO:teuthology.orchestra.run.smithi026.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-28T00:02:16.998 INFO:teuthology.orchestra.run.smithi026.stdout:hardware devices. 2023-09-28T00:02:16.998 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:02:16.998 INFO:teuthology.orchestra.run.smithi026.stdout:This subpackage provides tools for support of all platforms. 2023-09-28T00:02:16.999 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-28T00:02:16.999 INFO:teuthology.task.kernel:Updating grub on smithi026 to boot 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:16.999 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-28T00:02:17.806 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2023-09-28T00:02:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2023-09-28T00:02:20.047 INFO:teuthology.orchestra.run.smithi190.stderr:done 2023-09-28T00:02:20.050 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-09-28T00:02:20.063 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.kW33kB6aHo 2023-09-28T00:02:20.064 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.kW33kB6aHo 2023-09-28T00:02:20.134 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.kW33kB6aHo 2023-09-28T00:02:20.293 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.kW33kB6aHo is 6KB 2023-09-28T00:02:20.311 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.kW33kB6aHo 2023-09-28T00:02:20.324 DEBUG:teuthology.orchestra.run.smithi190:> sudo /bin/ls /boot/loader/entries || true 2023-09-28T00:02:20.385 INFO:teuthology.orchestra.run.smithi190.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-09-28T00:02:20.385 INFO:teuthology.orchestra.run.smithi190.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-09-28T00:02:20.386 INFO:teuthology.orchestra.run.smithi190.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-09-28T00:02:20.386 INFO:teuthology.orchestra.run.smithi190.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-09-28T00:02:20.387 DEBUG:teuthology.orchestra.run.smithi190:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:20.568 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2023-09-28T00:02:20.618 INFO:teuthology.orchestra.run.smithi026.stderr:done 2023-09-28T00:02:20.619 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-09-28T00:02:20.647 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.s8ofzyO50h 2023-09-28T00:02:20.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.s8ofzyO50h 2023-09-28T00:02:20.729 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.s8ofzyO50h 2023-09-28T00:02:20.886 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.s8ofzyO50h is 6KB 2023-09-28T00:02:20.933 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.s8ofzyO50h 2023-09-28T00:02:20.947 DEBUG:teuthology.orchestra.run.smithi026:> sudo /bin/ls /boot/loader/entries || true 2023-09-28T00:02:21.016 INFO:teuthology.orchestra.run.smithi026.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-09-28T00:02:21.017 INFO:teuthology.orchestra.run.smithi026.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-09-28T00:02:21.017 INFO:teuthology.orchestra.run.smithi026.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-09-28T00:02:21.017 INFO:teuthology.orchestra.run.smithi026.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-09-28T00:02:21.018 DEBUG:teuthology.orchestra.run.smithi026:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-09-28T00:02:21.219 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2023-09-28T00:02:50.598 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-09-28T00:02:50.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-09-28T00:02:50.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:02:51.222 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-28T00:02:51.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-09-28T00:02:51.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:03:09.050 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-09-28T00:03:09.566 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-09-28T00:03:18.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-09-28T00:03:18.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:03:18.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-09-28T00:03:18.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:03:21.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2023-09-28T00:03:33.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-09-28T00:03:33.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:03:36.954 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-09-28T00:03:48.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-09-28T00:03:48.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:03:49.528 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-09-28T00:03:49.816 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-09-28T00:03:49.817 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-09-28T00:03:49.817 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-09-28T00:03:49.833 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-425.3.1.el8.x86_64 2023-09-28T00:03:49.834 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:03:49.835 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-28T00:03:49.835 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-09-28T00:03:50.836 DEBUG:teuthology.parallel:result is None 2023-09-28T00:04:05.596 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-09-28T00:04:06.960 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-09-28T00:04:06.960 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-09-28T00:04:06.960 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2023-09-28T00:04:07.336 INFO:teuthology.orchestra.run.smithi190.stdout:4.18.0-425.3.1.el8.x86_64 2023-09-28T00:04:07.337 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-09-28T00:04:07.337 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-28T00:04:07.337 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-09-28T00:04:08.337 DEBUG:teuthology.parallel:result is None 2023-09-28T00:04:08.337 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-28T00:04:08.355 INFO:teuthology.task.internal:Creating test directory... 2023-09-28T00:04:08.355 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-28T00:04:08.359 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-28T00:04:08.377 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-28T00:04:08.382 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-28T00:04:08.390 INFO:teuthology.task.internal:Creating archive directory... 2023-09-28T00:04:08.390 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-28T00:04:08.417 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-28T00:04:08.497 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-28T00:04:08.503 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-28T00:04:08.504 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-28T00:04:08.506 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-28T00:04:08.602 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T00:04:08.617 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T00:04:08.702 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T00:04:08.722 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-28T00:04:08.723 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-28T00:04:08.729 INFO:teuthology.task.internal:Configuring sudo... 2023-09-28T00:04:08.729 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-28T00:04:08.732 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-28T00:04:08.757 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-28T00:04:08.764 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-28T00:04:08.765 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-28T00:04:08.800 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-28T00:04:08.814 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T00:04:08.895 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T00:04:08.963 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T00:04:09.004 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T00:04:09.045 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:04:09.045 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-28T00:04:09.109 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T00:04:09.152 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-28T00:04:09.240 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T00:04:09.279 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-28T00:04:09.319 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:04:09.319 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-28T00:04:09.383 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2023-09-28T00:04:09.385 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2023-09-28T00:04:09.442 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T00:04:09.484 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T00:04:09.954 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-28T00:04:09.962 INFO:teuthology.task.internal:Starting timer... 2023-09-28T00:04:09.962 INFO:teuthology.run_tasks:Running task pcp... 2023-09-28T00:04:09.971 INFO:teuthology.run_tasks:Running task selinux... 2023-09-28T00:04:09.980 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-09-28T00:04:09.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2023-09-28T00:04:10.052 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: [ OK ] 2023-09-28T00:04:10.054 DEBUG:teuthology.orchestra.run.smithi190:> sudo service auditd rotate 2023-09-28T00:04:10.142 INFO:teuthology.orchestra.run.smithi190.stdout:Rotating logs: [ OK ] 2023-09-28T00:04:10.144 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-28T00:04:10.144 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2023-09-28T00:04:10.167 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2023-09-28T00:04:10.167 DEBUG:teuthology.orchestra.run.smithi190:> /usr/sbin/getenforce 2023-09-28T00:04:10.183 INFO:teuthology.orchestra.run.smithi190.stdout:Permissive 2023-09-28T00:04:10.184 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi190.front.sepia.ceph.com': 'permissive'} 2023-09-28T00:04:10.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T00:04:10.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:04:10.233 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T00:04:10.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:04:10.258 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-28T00:04:10.258 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2023-09-28T00:04:10.300 DEBUG:teuthology.orchestra.run.smithi190:> sudo /usr/sbin/setenforce permissive 2023-09-28T00:04:10.324 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-28T00:04:10.387 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-28T00:04:10.387 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-28T00:04:10.408 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-28T00:04:10.409 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-28T00:12:25.596 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2023-09-28T00:12:25.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-09-28T00:12:25.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:12:25.666 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-09-28T00:12:25.691 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-09-28T00:12:25.691 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-09-28T00:12:25.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T00:12:25.760 DEBUG:teuthology.orchestra.run.smithi190:> true 2023-09-28T00:12:25.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2023-09-28T00:12:25.825 INFO:teuthology.run_tasks:Running task clock... 2023-09-28T00:12:25.838 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-28T00:12:25.839 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-28T00:12:25.839 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T00:12:25.842 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-28T00:12:25.842 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T00:12:25.871 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-28T00:12:25.887 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-28T00:12:25.895 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-28T00:12:25.909 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-28T00:12:25.922 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2023-09-28T00:12:25.932 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2023-09-28T00:12:25.942 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: ntpd: command not found 2023-09-28T00:12:25.946 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-28T00:12:25.952 INFO:teuthology.orchestra.run.smithi190.stdout:506 Cannot talk to daemon 2023-09-28T00:12:25.960 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-28T00:12:25.966 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-28T00:12:25.980 INFO:teuthology.orchestra.run.smithi190.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-28T00:12:26.039 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2023-09-28T00:12:26.041 INFO:teuthology.orchestra.run.smithi026.stdout:210 Number of sources = 4 2023-09-28T00:12:26.042 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T00:12:26.042 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2023-09-28T00:12:26.042 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:12:26.042 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:12:26.042 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:12:26.042 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:12:26.048 INFO:teuthology.orchestra.run.smithi190.stderr:bash: ntpq: command not found 2023-09-28T00:12:26.051 INFO:teuthology.orchestra.run.smithi190.stdout:210 Number of sources = 4 2023-09-28T00:12:26.051 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T00:12:26.051 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2023-09-28T00:12:26.051 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:12:26.051 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:12:26.051 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:12:26.051 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:12:26.052 INFO:teuthology.run_tasks:Running task install... 2023-09-28T00:12:26.060 DEBUG:teuthology.task.install:project ceph 2023-09-28T00:12:26.061 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}} 2023-09-28T00:12:26.061 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'} 2023-09-28T00:12:26.061 INFO:teuthology.task.install:Using flavor: default 2023-09-28T00:12:26.067 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-28T00:12:26.067 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-28T00:12:26.067 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'tag': None, 'wait_for_package': False} 2023-09-28T00:12:26.068 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:12:26.069 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'tag': None, 'wait_for_package': False} 2023-09-28T00:12:26.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:12:26.208 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/ 2023-09-28T00:12:26.208 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1161.g471b6dfd 2023-09-28T00:12:26.213 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/ 2023-09-28T00:12:26.213 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1161.g471b6dfd 2023-09-28T00:12:26.313 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-28T00:12:26.313 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:12:26.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-28T00:12:26.318 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-09-27-0906-quincy/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-28T00:12:26.318 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:12:26.319 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-28T00:12:26.340 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-28T00:12:26.341 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-28T00:12:26.344 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-28T00:12:26.344 DEBUG:teuthology.orchestra.run.smithi190:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-28T00:12:26.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-28T00:12:26.409 DEBUG:teuthology.orchestra.run.smithi190:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-28T00:12:26.484 DEBUG:teuthology.orchestra.run.smithi190:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-28T00:12:26.485 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-28T00:12:26.549 INFO:teuthology.orchestra.run.smithi190.stdout:check_obsoletes = 1 2023-09-28T00:12:26.550 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum clean all 2023-09-28T00:12:26.551 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2023-09-28T00:12:26.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2023-09-28T00:12:26.939 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-09-28T00:12:26.962 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-09-28T00:12:27.306 INFO:teuthology.orchestra.run.smithi190.stdout:44 files removed 2023-09-28T00:12:27.341 INFO:teuthology.orchestra.run.smithi026.stdout:44 files removed 2023-09-28T00:12:27.356 DEBUG:teuthology.orchestra.run.smithi190:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-28T00:12:27.393 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-28T00:12:27.704 INFO:teuthology.orchestra.run.smithi190.stdout:Updating Subscription Management repositories. 2023-09-28T00:12:27.761 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-09-28T00:12:28.472 INFO:teuthology.orchestra.run.smithi190.stdout:ceph packages for x86_64 352 kB/s | 78 kB 00:00 2023-09-28T00:12:28.611 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 250 kB/s | 78 kB 00:00 2023-09-28T00:12:28.819 INFO:teuthology.orchestra.run.smithi190.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-09-28T00:12:28.897 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-09-28T00:12:29.090 INFO:teuthology.orchestra.run.smithi190.stdout:ceph source packages 6.0 kB/s | 1.4 kB 00:00 2023-09-28T00:12:29.116 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 7.8 kB/s | 1.4 kB 00:00 2023-09-28T00:12:29.202 INFO:teuthology.orchestra.run.smithi190.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-09-28T00:12:29.231 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 41 kB/s | 3.5 kB 00:00 2023-09-28T00:12:29.925 INFO:teuthology.orchestra.run.smithi190.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-09-28T00:12:30.268 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-09-28T00:12:33.182 INFO:teuthology.orchestra.run.smithi190.stdout:lab-extras 4.7 MB/s | 24 kB 00:00 2023-09-28T00:12:33.556 INFO:teuthology.orchestra.run.smithi190.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 113 MB/s | 33 MB 00:00 2023-09-28T00:12:33.911 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2023-09-28T00:12:34.346 INFO:teuthology.orchestra.run.smithi026.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 110 MB/s | 38 MB 00:00 2023-09-28T00:12:38.680 INFO:teuthology.orchestra.run.smithi190.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 127 MB/s | 38 MB 00:00 2023-09-28T00:12:40.470 INFO:teuthology.orchestra.run.smithi026.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 107 MB/s | 33 MB 00:00 2023-09-28T00:12:46.916 INFO:teuthology.orchestra.run.smithi190.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T00:12:46.917 INFO:teuthology.orchestra.run.smithi190.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T00:12:46.927 INFO:teuthology.orchestra.run.smithi190.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-09-28T00:12:46.929 INFO:teuthology.orchestra.run.smithi190.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-09-28T00:12:46.929 INFO:teuthology.orchestra.run.smithi190.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-09-28T00:12:46.930 INFO:teuthology.orchestra.run.smithi190.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-28T00:12:46.931 INFO:teuthology.orchestra.run.smithi190.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-28T00:12:46.934 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-09-28T00:12:46.935 INFO:teuthology.orchestra.run.smithi190.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-09-28T00:12:47.418 INFO:teuthology.orchestra.run.smithi190.stdout:Dependencies resolved. 2023-09-28T00:12:47.429 INFO:teuthology.orchestra.run.smithi190.stdout:====================================================================================================================== 2023-09-28T00:12:47.429 INFO:teuthology.orchestra.run.smithi190.stdout: Package Arch Version Repository Size 2023-09-28T00:12:47.429 INFO:teuthology.orchestra.run.smithi190.stdout:====================================================================================================================== 2023-09-28T00:12:47.429 INFO:teuthology.orchestra.run.smithi190.stdout:Installing: 2023-09-28T00:12:47.429 INFO:teuthology.orchestra.run.smithi190.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-28T00:12:47.429 INFO:teuthology.orchestra.run.smithi190.stdout: ceph x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 6.4 k 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.2 M 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 874 k 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 162 k 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 1.6 M 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 121 k 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 1.7 M 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 7.4 M 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 47 k 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T00:12:47.430 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 52 M 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 267 k 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 80 k 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 255 k 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 18 k 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 25 k 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 796 k 2023-09-28T00:12:47.431 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 130 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 190 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 371 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 359 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 107 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 91 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 173 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-09-28T00:12:47.432 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrading: 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout: librados2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.6 M 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout:Installing dependencies: 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 23 M 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 23 k 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 2.3 M 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 238 k 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.9 M 2023-09-28T00:12:47.433 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 14 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 24 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 175 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-09-28T00:12:47.434 INFO:teuthology.orchestra.run.smithi190.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 507 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.6 M 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-28T00:12:47.435 INFO:teuthology.orchestra.run.smithi190.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 45 k 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 115 k 2023-09-28T00:12:47.436 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-28T00:12:47.437 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-28T00:12:47.438 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-28T00:12:47.439 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction Summary 2023-09-28T00:12:47.440 INFO:teuthology.orchestra.run.smithi190.stdout:====================================================================================================================== 2023-09-28T00:12:47.441 INFO:teuthology.orchestra.run.smithi190.stdout:Install 118 Packages 2023-09-28T00:12:47.441 INFO:teuthology.orchestra.run.smithi190.stdout:Upgrade 2 Packages 2023-09-28T00:12:47.441 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:12:47.441 INFO:teuthology.orchestra.run.smithi190.stdout:Total download size: 201 M 2023-09-28T00:12:47.441 INFO:teuthology.orchestra.run.smithi190.stdout:Downloading Packages: 2023-09-28T00:12:47.757 INFO:teuthology.orchestra.run.smithi190.stdout:(1/120): ceph-17.2.6-1161.g471b6dfd.el8.x86_64. 72 kB/s | 6.4 kB 00:00 2023-09-28T00:12:47.915 INFO:teuthology.orchestra.run.smithi190.stdout:(2/120): ceph-fuse-17.2.6-1161.g471b6dfd.el8.x8 5.4 MB/s | 874 kB 00:00 2023-09-28T00:12:47.955 INFO:teuthology.orchestra.run.smithi190.stdout:(3/120): ceph-immutable-object-cache-17.2.6-116 3.9 MB/s | 162 kB 00:00 2023-09-28T00:12:48.161 INFO:teuthology.orchestra.run.smithi190.stdout:(4/120): ceph-mds-17.2.6-1161.g471b6dfd.el8.x86 11 MB/s | 2.3 MB 00:00 2023-09-28T00:12:48.357 INFO:teuthology.orchestra.run.smithi190.stdout:(5/120): ceph-mgr-17.2.6-1161.g471b6dfd.el8.x86 8.0 MB/s | 1.6 MB 00:00 2023-09-28T00:12:49.177 INFO:teuthology.orchestra.run.smithi190.stdout:(6/120): ceph-common-17.2.6-1161.g471b6dfd.el8. 16 MB/s | 23 MB 00:01 2023-09-28T00:12:49.260 INFO:teuthology.orchestra.run.smithi190.stdout:(7/120): ceph-mon-17.2.6-1161.g471b6dfd.el8.x86 4.4 MB/s | 3.9 MB 00:00 2023-09-28T00:12:49.276 INFO:teuthology.orchestra.run.smithi190.stdout:(8/120): ceph-base-17.2.6-1161.g471b6dfd.el8.x8 3.2 MB/s | 5.2 MB 00:01 2023-09-28T00:12:49.311 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T00:12:49.311 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-28T00:12:49.323 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-09-28T00:12:49.324 INFO:teuthology.orchestra.run.smithi026.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-09-28T00:12:49.325 INFO:teuthology.orchestra.run.smithi026.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-09-28T00:12:49.325 INFO:teuthology.orchestra.run.smithi026.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-28T00:12:49.327 INFO:teuthology.orchestra.run.smithi026.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-28T00:12:49.330 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-09-28T00:12:49.330 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-09-28T00:12:49.340 INFO:teuthology.orchestra.run.smithi190.stdout:(9/120): ceph-selinux-17.2.6-1161.g471b6dfd.el8 381 kB/s | 24 kB 00:00 2023-09-28T00:12:49.852 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-09-28T00:12:49.864 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================================================== 2023-09-28T00:12:49.865 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2023-09-28T00:12:49.865 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================================================== 2023-09-28T00:12:49.865 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2023-09-28T00:12:49.865 INFO:teuthology.orchestra.run.smithi026.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-28T00:12:49.865 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 6.4 k 2023-09-28T00:12:49.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.2 M 2023-09-28T00:12:49.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 874 k 2023-09-28T00:12:49.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 162 k 2023-09-28T00:12:49.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 1.6 M 2023-09-28T00:12:49.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 121 k 2023-09-28T00:12:49.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 1.7 M 2023-09-28T00:12:49.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 7.4 M 2023-09-28T00:12:49.866 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 47 k 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 52 M 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 267 k 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 80 k 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 255 k 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 18 k 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-28T00:12:49.867 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 25 k 2023-09-28T00:12:49.868 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 796 k 2023-09-28T00:12:49.868 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 130 k 2023-09-28T00:12:49.868 INFO:teuthology.orchestra.run.smithi026.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-28T00:12:49.868 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-09-28T00:12:49.868 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-28T00:12:49.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 190 k 2023-09-28T00:12:49.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 371 k 2023-09-28T00:12:49.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 359 k 2023-09-28T00:12:49.868 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 107 k 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 91 k 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 173 k 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.5 M 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.6 M 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-28T00:12:49.869 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 23 M 2023-09-28T00:12:49.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 23 k 2023-09-28T00:12:49.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 2.3 M 2023-09-28T00:12:49.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 238 k 2023-09-28T00:12:49.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 3.9 M 2023-09-28T00:12:49.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 17 M 2023-09-28T00:12:49.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1161.g471b6dfd.el8 ceph-noarch 14 k 2023-09-28T00:12:49.870 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 24 k 2023-09-28T00:12:49.870 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-28T00:12:49.870 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-28T00:12:49.871 INFO:teuthology.orchestra.run.smithi026.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-09-28T00:12:49.871 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-28T00:12:49.871 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-28T00:12:49.871 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 175 k 2023-09-28T00:12:49.871 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-09-28T00:12:49.871 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-09-28T00:12:49.871 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-28T00:12:49.871 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-09-28T00:12:49.871 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-28T00:12:49.872 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 507 k 2023-09-28T00:12:49.872 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-09-28T00:12:49.872 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 5.6 M 2023-09-28T00:12:49.872 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-28T00:12:49.872 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-09-28T00:12:49.872 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-28T00:12:49.872 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-28T00:12:49.872 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-28T00:12:49.872 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-28T00:12:49.873 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-09-28T00:12:49.873 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-28T00:12:49.873 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-28T00:12:49.873 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-28T00:12:49.873 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-28T00:12:49.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-28T00:12:49.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-28T00:12:49.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-28T00:12:49.873 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-28T00:12:49.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-28T00:12:49.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 45 k 2023-09-28T00:12:49.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:17.2.6-1161.g471b6dfd.el8 ceph 115 k 2023-09-28T00:12:49.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-28T00:12:49.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-28T00:12:49.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-28T00:12:49.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-28T00:12:49.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-28T00:12:49.874 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-28T00:12:49.875 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-28T00:12:49.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-28T00:12:49.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-28T00:12:49.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-28T00:12:49.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-28T00:12:49.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-28T00:12:49.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-28T00:12:49.876 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-28T00:12:49.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-28T00:12:49.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-28T00:12:49.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-28T00:12:49.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-28T00:12:49.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-28T00:12:49.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-28T00:12:49.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-09-28T00:12:49.877 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-28T00:12:49.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-28T00:12:49.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-28T00:12:49.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-28T00:12:49.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-28T00:12:49.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-28T00:12:49.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-28T00:12:49.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-28T00:12:49.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-28T00:12:49.878 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout:====================================================================================================================== 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout:Install 118 Packages 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 2 Packages 2023-09-28T00:12:49.879 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:12:49.880 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 201 M 2023-09-28T00:12:49.880 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2023-09-28T00:12:50.239 INFO:teuthology.orchestra.run.smithi026.stdout:(1/120): ceph-17.2.6-1161.g471b6dfd.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-09-28T00:12:50.294 INFO:teuthology.orchestra.run.smithi190.stdout:(10/120): ceph-osd-17.2.6-1161.g471b6dfd.el8.x8 15 MB/s | 17 MB 00:01 2023-09-28T00:12:50.864 INFO:teuthology.orchestra.run.smithi026.stdout:(2/120): ceph-base-17.2.6-1161.g471b6dfd.el8.x8 5.4 MB/s | 5.2 MB 00:00 2023-09-28T00:12:50.923 INFO:teuthology.orchestra.run.smithi026.stdout:(3/120): ceph-immutable-object-cache-17.2.6-116 2.6 MB/s | 162 kB 00:00 2023-09-28T00:12:50.984 INFO:teuthology.orchestra.run.smithi026.stdout:(4/120): ceph-fuse-17.2.6-1161.g471b6dfd.el8.x8 1.1 MB/s | 874 kB 00:00 2023-09-28T00:12:51.249 INFO:teuthology.orchestra.run.smithi190.stdout:(11/120): cephfs-mirror-17.2.6-1161.g471b6dfd.e 267 kB/s | 255 kB 00:00 2023-09-28T00:12:51.274 INFO:teuthology.orchestra.run.smithi026.stdout:(5/120): ceph-mds-17.2.6-1161.g471b6dfd.el8.x86 6.6 MB/s | 2.3 MB 00:00 2023-09-28T00:12:51.301 INFO:teuthology.orchestra.run.smithi190.stdout:(12/120): libcephfs-devel-17.2.6-1161.g471b6dfd 478 kB/s | 25 kB 00:00 2023-09-28T00:12:51.858 INFO:teuthology.orchestra.run.smithi026.stdout:(6/120): ceph-mgr-17.2.6-1161.g471b6dfd.el8.x86 1.8 MB/s | 1.6 MB 00:00 2023-09-28T00:12:51.984 INFO:teuthology.orchestra.run.smithi026.stdout:(7/120): ceph-mon-17.2.6-1161.g471b6dfd.el8.x86 5.6 MB/s | 3.9 MB 00:00 2023-09-28T00:12:52.125 INFO:teuthology.orchestra.run.smithi190.stdout:(13/120): ceph-radosgw-17.2.6-1161.g471b6dfd.el 5.8 MB/s | 17 MB 00:02 2023-09-28T00:12:52.129 INFO:teuthology.orchestra.run.smithi190.stdout:(14/120): libcephfs2-17.2.6-1161.g471b6dfd.el8. 961 kB/s | 796 kB 00:00 2023-09-28T00:12:52.181 INFO:teuthology.orchestra.run.smithi190.stdout:(15/120): libcephsqlite-17.2.6-1161.g471b6dfd.e 3.1 MB/s | 175 kB 00:00 2023-09-28T00:12:52.191 INFO:teuthology.orchestra.run.smithi190.stdout:(16/120): librados-devel-17.2.6-1161.g471b6dfd. 2.1 MB/s | 130 kB 00:00 2023-09-28T00:12:52.315 INFO:teuthology.orchestra.run.smithi190.stdout:(17/120): libradosstriper1-17.2.6-1161.g471b6df 3.7 MB/s | 507 kB 00:00 2023-09-28T00:12:52.380 INFO:teuthology.orchestra.run.smithi190.stdout:(18/120): python3-ceph-argparse-17.2.6-1161.g47 683 kB/s | 45 kB 00:00 2023-09-28T00:12:52.448 INFO:teuthology.orchestra.run.smithi190.stdout:(19/120): python3-ceph-common-17.2.6-1161.g471b 1.7 MB/s | 115 kB 00:00 2023-09-28T00:12:52.519 INFO:teuthology.orchestra.run.smithi190.stdout:(20/120): python3-cephfs-17.2.6-1161.g471b6dfd. 2.6 MB/s | 190 kB 00:00 2023-09-28T00:12:52.659 INFO:teuthology.orchestra.run.smithi190.stdout:(21/120): python3-rados-17.2.6-1161.g471b6dfd.e 2.6 MB/s | 371 kB 00:00 2023-09-28T00:12:52.796 INFO:teuthology.orchestra.run.smithi190.stdout:(22/120): python3-rbd-17.2.6-1161.g471b6dfd.el8 2.6 MB/s | 359 kB 00:00 2023-09-28T00:12:52.859 INFO:teuthology.orchestra.run.smithi190.stdout:(23/120): python3-rgw-17.2.6-1161.g471b6dfd.el8 1.7 MB/s | 107 kB 00:00 2023-09-28T00:12:52.888 INFO:teuthology.orchestra.run.smithi190.stdout:(24/120): librgw2-17.2.6-1161.g471b6dfd.el8.x86 8.0 MB/s | 5.6 MB 00:00 2023-09-28T00:12:52.890 INFO:teuthology.orchestra.run.smithi190.stdout:(25/120): rbd-fuse-17.2.6-1161.g471b6dfd.el8.x8 2.8 MB/s | 91 kB 00:00 2023-09-28T00:12:52.932 INFO:teuthology.orchestra.run.smithi190.stdout:(26/120): rbd-nbd-17.2.6-1161.g471b6dfd.el8.x86 4.0 MB/s | 173 kB 00:00 2023-09-28T00:12:52.982 INFO:teuthology.orchestra.run.smithi190.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1161.g 470 kB/s | 23 kB 00:00 2023-09-28T00:12:53.016 INFO:teuthology.orchestra.run.smithi190.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1161.g471b6df 3.5 MB/s | 121 kB 00:00 2023-09-28T00:12:53.017 INFO:teuthology.orchestra.run.smithi026.stdout:(8/120): ceph-common-17.2.6-1161.g471b6dfd.el8. 7.5 MB/s | 23 MB 00:03 2023-09-28T00:12:53.080 INFO:teuthology.orchestra.run.smithi026.stdout:(9/120): ceph-selinux-17.2.6-1161.g471b6dfd.el8 388 kB/s | 24 kB 00:00 2023-09-28T00:12:53.193 INFO:teuthology.orchestra.run.smithi190.stdout:(29/120): rbd-mirror-17.2.6-1161.g471b6dfd.el8. 11 MB/s | 3.5 MB 00:00 2023-09-28T00:12:53.430 INFO:teuthology.orchestra.run.smithi190.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1161.g471b6 4.1 MB/s | 1.7 MB 00:00 2023-09-28T00:12:53.508 INFO:teuthology.orchestra.run.smithi190.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1161.g47 3.0 MB/s | 238 kB 00:00 2023-09-28T00:12:53.579 INFO:teuthology.orchestra.run.smithi190.stdout:(32/120): ceph-mgr-rook-17.2.6-1161.g471b6dfd.e 669 kB/s | 47 kB 00:00 2023-09-28T00:12:53.646 INFO:teuthology.orchestra.run.smithi190.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1161.g4 216 kB/s | 14 kB 00:00 2023-09-28T00:12:53.722 INFO:teuthology.orchestra.run.smithi190.stdout:(34/120): ceph-volume-17.2.6-1161.g471b6dfd.el8 3.5 MB/s | 267 kB 00:00 2023-09-28T00:12:53.794 INFO:teuthology.orchestra.run.smithi190.stdout:(35/120): cephadm-17.2.6-1161.g471b6dfd.el8.noa 1.1 MB/s | 80 kB 00:00 2023-09-28T00:12:53.859 INFO:teuthology.orchestra.run.smithi190.stdout:(36/120): cephfs-top-17.2.6-1161.g471b6dfd.el8. 275 kB/s | 18 kB 00:00 2023-09-28T00:12:54.070 INFO:teuthology.orchestra.run.smithi190.stdout:(37/120): ceph-mgr-diskprediction-local-17.2.6- 8.4 MB/s | 7.4 MB 00:00 2023-09-28T00:12:54.877 INFO:teuthology.orchestra.run.smithi026.stdout:(10/120): ceph-radosgw-17.2.6-1161.g471b6dfd.el 5.8 MB/s | 17 MB 00:02 2023-09-28T00:12:54.911 INFO:teuthology.orchestra.run.smithi026.stdout:(11/120): cephfs-mirror-17.2.6-1161.g471b6dfd.e 7.3 MB/s | 255 kB 00:00 2023-09-28T00:12:54.945 INFO:teuthology.orchestra.run.smithi026.stdout:(12/120): libcephfs-devel-17.2.6-1161.g471b6dfd 751 kB/s | 25 kB 00:00 2023-09-28T00:12:55.069 INFO:teuthology.orchestra.run.smithi026.stdout:(13/120): libcephfs2-17.2.6-1161.g471b6dfd.el8. 6.3 MB/s | 796 kB 00:00 2023-09-28T00:12:55.105 INFO:teuthology.orchestra.run.smithi026.stdout:(14/120): libcephsqlite-17.2.6-1161.g471b6dfd.e 4.7 MB/s | 175 kB 00:00 2023-09-28T00:12:55.136 INFO:teuthology.orchestra.run.smithi190.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 55 kB/s | 59 kB 00:01 2023-09-28T00:12:55.143 INFO:teuthology.orchestra.run.smithi026.stdout:(15/120): librados-devel-17.2.6-1161.g471b6dfd. 3.4 MB/s | 130 kB 00:00 2023-09-28T00:12:55.226 INFO:teuthology.orchestra.run.smithi026.stdout:(16/120): libradosstriper1-17.2.6-1161.g471b6df 6.0 MB/s | 507 kB 00:00 2023-09-28T00:12:55.361 INFO:teuthology.orchestra.run.smithi190.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 204 kB/s | 306 kB 00:01 2023-09-28T00:12:55.485 INFO:teuthology.orchestra.run.smithi190.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 216 kB/s | 75 kB 00:00 2023-09-28T00:12:55.761 INFO:teuthology.orchestra.run.smithi190.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 158 kB/s | 44 kB 00:00 2023-09-28T00:12:55.838 INFO:teuthology.orchestra.run.smithi190.stdout:(42/120): python3-asyncssh-2.7.0-2.el8.noarch.r 997 kB/s | 476 kB 00:00 2023-09-28T00:12:55.926 INFO:teuthology.orchestra.run.smithi026.stdout:(17/120): librgw2-17.2.6-1161.g471b6dfd.el8.x86 7.9 MB/s | 5.6 MB 00:00 2023-09-28T00:12:55.960 INFO:teuthology.orchestra.run.smithi026.stdout:(18/120): python3-ceph-argparse-17.2.6-1161.g47 1.3 MB/s | 45 kB 00:00 2023-09-28T00:12:56.001 INFO:teuthology.orchestra.run.smithi026.stdout:(19/120): python3-ceph-common-17.2.6-1161.g471b 2.8 MB/s | 115 kB 00:00 2023-09-28T00:12:56.041 INFO:teuthology.orchestra.run.smithi026.stdout:(20/120): python3-cephfs-17.2.6-1161.g471b6dfd. 4.8 MB/s | 190 kB 00:00 2023-09-28T00:12:56.047 INFO:teuthology.orchestra.run.smithi190.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 158 kB/s | 33 kB 00:00 2023-09-28T00:12:56.087 INFO:teuthology.orchestra.run.smithi026.stdout:(21/120): python3-rados-17.2.6-1161.g471b6dfd.e 7.9 MB/s | 371 kB 00:00 2023-09-28T00:12:56.138 INFO:teuthology.orchestra.run.smithi026.stdout:(22/120): python3-rbd-17.2.6-1161.g471b6dfd.el8 6.9 MB/s | 359 kB 00:00 2023-09-28T00:12:56.179 INFO:teuthology.orchestra.run.smithi026.stdout:(23/120): python3-rgw-17.2.6-1161.g471b6dfd.el8 2.5 MB/s | 107 kB 00:00 2023-09-28T00:12:56.212 INFO:teuthology.orchestra.run.smithi026.stdout:(24/120): rbd-fuse-17.2.6-1161.g471b6dfd.el8.x8 2.7 MB/s | 91 kB 00:00 2023-09-28T00:12:56.254 INFO:teuthology.orchestra.run.smithi190.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 79 kB/s | 16 kB 00:00 2023-09-28T00:12:56.262 INFO:teuthology.orchestra.run.smithi190.stdout:(45/120): python3-beautifulsoup4-4.6.3-2.el8.1. 369 kB/s | 185 kB 00:00 2023-09-28T00:12:56.493 INFO:teuthology.orchestra.run.smithi190.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 722 kB/s | 173 kB 00:00 2023-09-28T00:12:56.647 INFO:teuthology.orchestra.run.smithi026.stdout:(25/120): rbd-mirror-17.2.6-1161.g471b6dfd.el8. 7.9 MB/s | 3.5 MB 00:00 2023-09-28T00:12:56.687 INFO:teuthology.orchestra.run.smithi026.stdout:(26/120): rbd-nbd-17.2.6-1161.g471b6dfd.el8.x86 4.2 MB/s | 173 kB 00:00 2023-09-28T00:12:56.711 INFO:teuthology.orchestra.run.smithi190.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 372 kB/s | 81 kB 00:00 2023-09-28T00:12:56.725 INFO:teuthology.orchestra.run.smithi026.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1161.g 619 kB/s | 23 kB 00:00 2023-09-28T00:12:56.744 INFO:teuthology.orchestra.run.smithi190.stdout:(48/120): python3-cherrypy-18.4.0-1.el8.noarch. 799 kB/s | 384 kB 00:00 2023-09-28T00:12:56.759 INFO:teuthology.orchestra.run.smithi026.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1161.g471b6df 3.5 MB/s | 121 kB 00:00 2023-09-28T00:12:56.916 INFO:teuthology.orchestra.run.smithi190.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 54 kB/s | 11 kB 00:00 2023-09-28T00:12:56.958 INFO:teuthology.orchestra.run.smithi190.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 82 kB/s | 18 kB 00:00 2023-09-28T00:12:56.989 INFO:teuthology.orchestra.run.smithi026.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1161.g471b6 7.4 MB/s | 1.7 MB 00:00 2023-09-28T00:12:57.183 INFO:teuthology.orchestra.run.smithi190.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 217 kB/s | 49 kB 00:00 2023-09-28T00:12:57.375 INFO:teuthology.orchestra.run.smithi190.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 2.5 MB/s | 1.2 MB 00:00 2023-09-28T00:12:57.408 INFO:teuthology.orchestra.run.smithi190.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 260 kB/s | 59 kB 00:00 2023-09-28T00:12:57.581 INFO:teuthology.orchestra.run.smithi190.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 292 kB/s | 60 kB 00:00 2023-09-28T00:12:57.693 INFO:teuthology.orchestra.run.smithi190.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 994 kB/s | 283 kB 00:00 2023-09-28T00:12:57.784 INFO:teuthology.orchestra.run.smithi190.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 77 kB/s | 16 kB 00:00 2023-09-28T00:12:57.911 INFO:teuthology.orchestra.run.smithi190.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 155 kB/s | 34 kB 00:00 2023-09-28T00:12:58.001 INFO:teuthology.orchestra.run.smithi190.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 906 kB/s | 196 kB 00:00 2023-09-28T00:12:58.011 INFO:teuthology.orchestra.run.smithi026.stdout:(30/120): ceph-test-17.2.6-1161.g471b6dfd.el8.x 10 MB/s | 52 MB 00:04 2023-09-28T00:12:58.047 INFO:teuthology.orchestra.run.smithi026.stdout:(31/120): ceph-mgr-diskprediction-local-17.2.6- 7.0 MB/s | 7.4 MB 00:01 2023-09-28T00:12:58.049 INFO:teuthology.orchestra.run.smithi026.stdout:(32/120): ceph-mgr-modules-core-17.2.6-1161.g47 6.2 MB/s | 238 kB 00:00 2023-09-28T00:12:58.069 INFO:teuthology.orchestra.run.smithi026.stdout:(33/120): ceph-mgr-rook-17.2.6-1161.g471b6dfd.e 2.1 MB/s | 47 kB 00:00 2023-09-28T00:12:58.071 INFO:teuthology.orchestra.run.smithi026.stdout:(34/120): ceph-prometheus-alerts-17.2.6-1161.g4 686 kB/s | 14 kB 00:00 2023-09-28T00:12:58.093 INFO:teuthology.orchestra.run.smithi026.stdout:(35/120): ceph-volume-17.2.6-1161.g471b6dfd.el8 11 MB/s | 267 kB 00:00 2023-09-28T00:12:58.094 INFO:teuthology.orchestra.run.smithi026.stdout:(36/120): cephadm-17.2.6-1161.g471b6dfd.el8.noa 3.5 MB/s | 80 kB 00:00 2023-09-28T00:12:58.114 INFO:teuthology.orchestra.run.smithi026.stdout:(37/120): cephfs-top-17.2.6-1161.g471b6dfd.el8. 846 kB/s | 18 kB 00:00 2023-09-28T00:12:58.279 INFO:teuthology.orchestra.run.smithi026.stdout:(38/120): ceph-osd-17.2.6-1161.g471b6dfd.el8.x8 2.6 MB/s | 17 MB 00:06 2023-09-28T00:12:58.384 INFO:teuthology.orchestra.run.smithi190.stdout:(59/120): ceph-test-17.2.6-1161.g471b6dfd.el8.x 5.7 MB/s | 52 MB 00:09 2023-09-28T00:12:58.384 INFO:teuthology.orchestra.run.smithi190.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 49 kB/s | 19 kB 00:00 2023-09-28T00:12:58.385 INFO:teuthology.orchestra.run.smithi190.stdout:(61/120): python3-rsa-4.9-2.el8.noarch.rpm 135 kB/s | 64 kB 00:00 2023-09-28T00:12:58.590 INFO:teuthology.orchestra.run.smithi190.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 142 kB/s | 29 kB 00:00 2023-09-28T00:12:58.601 INFO:teuthology.orchestra.run.smithi190.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 127 kB/s | 27 kB 00:00 2023-09-28T00:12:58.619 INFO:teuthology.orchestra.run.smithi026.stdout:(39/120): liboath-2.6.2-3.el8.x86_64.rpm 116 kB/s | 59 kB 00:00 2023-09-28T00:12:58.729 INFO:teuthology.orchestra.run.smithi026.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 171 kB/s | 75 kB 00:00 2023-09-28T00:12:58.797 INFO:teuthology.orchestra.run.smithi026.stdout:(41/120): gperftools-libs-2.7-9.el8.x86_64.rpm 435 kB/s | 306 kB 00:00 2023-09-28T00:12:58.813 INFO:teuthology.orchestra.run.smithi190.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 1.1 MB/s | 255 kB 00:00 2023-09-28T00:12:58.854 INFO:teuthology.orchestra.run.smithi026.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 347 kB/s | 44 kB 00:00 2023-09-28T00:12:58.877 INFO:teuthology.orchestra.run.smithi190.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 912 kB/s | 251 kB 00:00 2023-09-28T00:12:58.912 INFO:teuthology.orchestra.run.smithi026.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-09-28T00:12:58.948 INFO:teuthology.orchestra.run.smithi026.stdout:(44/120): python3-asyncssh-2.7.0-2.el8.noarch.r 1.4 MB/s | 476 kB 00:00 2023-09-28T00:12:58.957 INFO:teuthology.orchestra.run.smithi026.stdout:(45/120): python3-cachetools-3.1.1-4.el8.noarch 322 kB/s | 33 kB 00:00 2023-09-28T00:12:58.999 INFO:teuthology.orchestra.run.smithi026.stdout:(46/120): python3-certifi-2018.10.15-7.el8.noar 186 kB/s | 16 kB 00:00 2023-09-28T00:12:59.019 INFO:teuthology.orchestra.run.smithi190.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 297 kB/s | 61 kB 00:00 2023-09-28T00:12:59.068 INFO:teuthology.orchestra.run.smithi026.stdout:(47/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-09-28T00:12:59.095 INFO:teuthology.orchestra.run.smithi026.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 848 kB/s | 81 kB 00:00 2023-09-28T00:12:59.109 INFO:teuthology.orchestra.run.smithi190.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 368 kB/s | 85 kB 00:00 2023-09-28T00:12:59.158 INFO:teuthology.orchestra.run.smithi026.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 124 kB/s | 11 kB 00:00 2023-09-28T00:12:59.186 INFO:teuthology.orchestra.run.smithi026.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 195 kB/s | 18 kB 00:00 2023-09-28T00:12:59.221 INFO:teuthology.orchestra.run.smithi190.stdout:(68/120): python3-singledispatch-3.4.0.3-18.el8 29 kB/s | 24 kB 00:00 2023-09-28T00:12:59.222 INFO:teuthology.orchestra.run.smithi190.stdout:(69/120): python3-zc-lockfile-2.0-2.el8.noarch. 113 kB/s | 23 kB 00:00 2023-09-28T00:12:59.225 INFO:teuthology.orchestra.run.smithi190.stdout:(70/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 17 MB/s | 70 kB 00:00 2023-09-28T00:12:59.246 INFO:teuthology.orchestra.run.smithi026.stdout:(51/120): python3-cherrypy-18.4.0-1.el8.noarch. 1.3 MB/s | 384 kB 00:00 2023-09-28T00:12:59.261 INFO:teuthology.orchestra.run.smithi190.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.2 MB/s | 44 kB 00:00 2023-09-28T00:12:59.275 INFO:teuthology.orchestra.run.smithi190.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.8 MB/s | 27 kB 00:00 2023-09-28T00:12:59.278 INFO:teuthology.orchestra.run.smithi026.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 529 kB/s | 49 kB 00:00 2023-09-28T00:12:59.291 INFO:teuthology.orchestra.run.smithi190.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-09-28T00:12:59.309 INFO:teuthology.orchestra.run.smithi190.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 19 MB/s | 320 kB 00:00 2023-09-28T00:12:59.328 INFO:teuthology.orchestra.run.smithi190.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-09-28T00:12:59.344 INFO:teuthology.orchestra.run.smithi026.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 599 kB/s | 59 kB 00:00 2023-09-28T00:12:59.369 INFO:teuthology.orchestra.run.smithi026.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 663 kB/s | 60 kB 00:00 2023-09-28T00:12:59.381 INFO:teuthology.orchestra.run.smithi026.stdout:(55/120): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2023-09-28T00:12:59.410 INFO:teuthology.orchestra.run.smithi190.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 58 MB/s | 4.8 MB 00:00 2023-09-28T00:12:59.424 INFO:teuthology.orchestra.run.smithi190.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.8 MB/s | 39 kB 00:00 2023-09-28T00:12:59.456 INFO:teuthology.orchestra.run.smithi026.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 182 kB/s | 16 kB 00:00 2023-09-28T00:12:59.463 INFO:teuthology.orchestra.run.smithi026.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 414 kB/s | 34 kB 00:00 2023-09-28T00:12:59.467 INFO:teuthology.orchestra.run.smithi026.stdout:(58/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.3 MB/s | 283 kB 00:00 2023-09-28T00:12:59.535 INFO:teuthology.orchestra.run.smithi190.stdout:(78/120): python3-scipy-1.0.0-20.module+el8.1.0 46 MB/s | 15 MB 00:00 2023-09-28T00:12:59.543 INFO:teuthology.orchestra.run.smithi190.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 5.7 MB/s | 688 kB 00:00 2023-09-28T00:12:59.546 INFO:teuthology.orchestra.run.smithi026.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 772 kB/s | 64 kB 00:00 2023-09-28T00:12:59.555 INFO:teuthology.orchestra.run.smithi026.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 212 kB/s | 19 kB 00:00 2023-09-28T00:12:59.557 INFO:teuthology.orchestra.run.smithi190.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 16 MB/s | 225 kB 00:00 2023-09-28T00:12:59.571 INFO:teuthology.orchestra.run.smithi190.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 9.2 MB/s | 126 kB 00:00 2023-09-28T00:12:59.572 INFO:teuthology.orchestra.run.smithi190.stdout:(82/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.9 MB/s | 259 kB 00:00 2023-09-28T00:12:59.572 INFO:teuthology.orchestra.run.smithi026.stdout:(61/120): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-09-28T00:12:59.586 INFO:teuthology.orchestra.run.smithi190.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-09-28T00:12:59.606 INFO:teuthology.orchestra.run.smithi190.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 28 MB/s | 538 kB 00:00 2023-09-28T00:12:59.629 INFO:teuthology.orchestra.run.smithi026.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 293 kB/s | 24 kB 00:00 2023-09-28T00:12:59.629 INFO:teuthology.orchestra.run.smithi190.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 65 MB/s | 3.7 MB 00:00 2023-09-28T00:12:59.631 INFO:teuthology.orchestra.run.smithi190.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 12 MB/s | 302 kB 00:00 2023-09-28T00:12:59.642 INFO:teuthology.orchestra.run.smithi190.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-09-28T00:12:59.644 INFO:teuthology.orchestra.run.smithi190.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 7.9 MB/s | 110 kB 00:00 2023-09-28T00:12:59.647 INFO:teuthology.orchestra.run.smithi026.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 321 kB/s | 29 kB 00:00 2023-09-28T00:12:59.657 INFO:teuthology.orchestra.run.smithi190.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.6 MB/s | 20 kB 00:00 2023-09-28T00:12:59.659 INFO:teuthology.orchestra.run.smithi190.stdout:(90/120): librdkafka-0.11.4-1.el8.x86_64.rpm 21 MB/s | 353 kB 00:00 2023-09-28T00:12:59.667 INFO:teuthology.orchestra.run.smithi026.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 291 kB/s | 27 kB 00:00 2023-09-28T00:12:59.673 INFO:teuthology.orchestra.run.smithi190.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.0 MB/s | 54 kB 00:00 2023-09-28T00:12:59.678 INFO:teuthology.orchestra.run.smithi190.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 34 MB/s | 709 kB 00:00 2023-09-28T00:12:59.730 INFO:teuthology.orchestra.run.smithi026.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-09-28T00:12:59.749 INFO:teuthology.orchestra.run.smithi190.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 62 MB/s | 4.7 MB 00:00 2023-09-28T00:12:59.759 INFO:teuthology.orchestra.run.smithi026.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 666 kB/s | 61 kB 00:00 2023-09-28T00:12:59.764 INFO:teuthology.orchestra.run.smithi190.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 53 MB/s | 4.6 MB 00:00 2023-09-28T00:12:59.772 INFO:teuthology.orchestra.run.smithi190.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 30 MB/s | 713 kB 00:00 2023-09-28T00:12:59.772 INFO:teuthology.orchestra.run.smithi026.stdout:(67/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2023-09-28T00:12:59.776 INFO:teuthology.orchestra.run.smithi190.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.6 MB/s | 19 kB 00:00 2023-09-28T00:12:59.785 INFO:teuthology.orchestra.run.smithi190.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.3 MB/s | 43 kB 00:00 2023-09-28T00:12:59.789 INFO:teuthology.orchestra.run.smithi190.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2023-09-28T00:12:59.799 INFO:teuthology.orchestra.run.smithi190.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 15 MB/s | 220 kB 00:00 2023-09-28T00:12:59.802 INFO:teuthology.orchestra.run.smithi190.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 3.8 MB/s | 48 kB 00:00 2023-09-28T00:12:59.814 INFO:teuthology.orchestra.run.smithi190.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-09-28T00:12:59.815 INFO:teuthology.orchestra.run.smithi026.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-09-28T00:12:59.815 INFO:teuthology.orchestra.run.smithi190.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 3.2 MB/s | 43 kB 00:00 2023-09-28T00:12:59.820 INFO:teuthology.orchestra.run.smithi026.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-09-28T00:12:59.827 INFO:teuthology.orchestra.run.smithi190.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.4 MB/s | 18 kB 00:00 2023-09-28T00:12:59.837 INFO:teuthology.orchestra.run.smithi190.stdout:(104/120): thrift-0.13.0-2.el8.x86_64.rpm 2.4 MB/s | 1.7 MB 00:00 2023-09-28T00:12:59.852 INFO:teuthology.orchestra.run.smithi026.stdout:(70/120): python3-zc-lockfile-2.0-2.el8.noarch. 249 kB/s | 23 kB 00:00 2023-09-28T00:12:59.853 INFO:teuthology.orchestra.run.smithi026.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 570 kB/s | 19 kB 00:00 2023-09-28T00:12:59.853 INFO:teuthology.orchestra.run.smithi190.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-09-28T00:12:59.867 INFO:teuthology.orchestra.run.smithi190.stdout:(106/120): openssl-devel-1.1.1g-15.el8_3.x86_64 44 MB/s | 2.3 MB 00:00 2023-09-28T00:12:59.868 INFO:teuthology.orchestra.run.smithi190.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 3.8 MB/s | 59 kB 00:00 2023-09-28T00:12:59.869 INFO:teuthology.orchestra.run.smithi190.stdout:(108/120): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 83 kB 00:00 2023-09-28T00:12:59.873 INFO:teuthology.orchestra.run.smithi026.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 7.8 MB/s | 155 kB 00:00 2023-09-28T00:12:59.883 INFO:teuthology.orchestra.run.smithi190.stdout:(109/120): libquadmath-8.4.1-1.el8.x86_64.rpm 10 MB/s | 169 kB 00:00 2023-09-28T00:12:59.884 INFO:teuthology.orchestra.run.smithi190.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.5 MB/s | 86 kB 00:00 2023-09-28T00:12:59.886 INFO:teuthology.orchestra.run.smithi026.stdout:(73/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2023-09-28T00:12:59.887 INFO:teuthology.orchestra.run.smithi190.stdout:(111/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.0 MB/s | 38 kB 00:00 2023-09-28T00:12:59.899 INFO:teuthology.orchestra.run.smithi190.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.1 MB/s | 47 kB 00:00 2023-09-28T00:12:59.900 INFO:teuthology.orchestra.run.smithi026.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.1 MB/s | 220 kB 00:00 2023-09-28T00:12:59.902 INFO:teuthology.orchestra.run.smithi026.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.0 MB/s | 48 kB 00:00 2023-09-28T00:12:59.903 INFO:teuthology.orchestra.run.smithi190.stdout:(113/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 2.9 MB/s | 58 kB 00:00 2023-09-28T00:12:59.917 INFO:teuthology.orchestra.run.smithi190.stdout:(114/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 18 MB/s | 559 kB 00:00 2023-09-28T00:12:59.918 INFO:teuthology.orchestra.run.smithi026.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 2.7 MB/s | 43 kB 00:00 2023-09-28T00:12:59.918 INFO:teuthology.orchestra.run.smithi190.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 4.4 MB/s | 70 kB 00:00 2023-09-28T00:12:59.919 INFO:teuthology.orchestra.run.smithi026.stdout:(77/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 11 MB/s | 229 kB 00:00 2023-09-28T00:12:59.926 INFO:teuthology.orchestra.run.smithi190.stdout:(116/120): libgfortran-8.4.1-1.el8.x86_64.rpm 26 MB/s | 639 kB 00:00 2023-09-28T00:12:59.934 INFO:teuthology.orchestra.run.smithi026.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.2 MB/s | 18 kB 00:00 2023-09-28T00:12:59.935 INFO:teuthology.orchestra.run.smithi190.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 11 MB/s | 200 kB 00:00 2023-09-28T00:12:59.935 INFO:teuthology.orchestra.run.smithi190.stdout:(118/120): libuuid-devel-2.32.1-27.el8.x86_64.r 5.5 MB/s | 97 kB 00:00 2023-09-28T00:12:59.958 INFO:teuthology.orchestra.run.smithi026.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 25 MB/s | 605 kB 00:00 2023-09-28T00:12:59.973 INFO:teuthology.orchestra.run.smithi026.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 42 MB/s | 2.3 MB 00:00 2023-09-28T00:12:59.975 INFO:teuthology.orchestra.run.smithi026.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 4.8 MB/s | 83 kB 00:00 2023-09-28T00:12:59.987 INFO:teuthology.orchestra.run.smithi026.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.3 MB/s | 59 kB 00:00 2023-09-28T00:12:59.990 INFO:teuthology.orchestra.run.smithi026.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-09-28T00:13:00.000 INFO:teuthology.orchestra.run.smithi026.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 3.0 MB/s | 38 kB 00:00 2023-09-28T00:13:00.004 INFO:teuthology.orchestra.run.smithi026.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.0 MB/s | 86 kB 00:00 2023-09-28T00:13:00.013 INFO:teuthology.orchestra.run.smithi026.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2023-09-28T00:13:00.017 INFO:teuthology.orchestra.run.smithi026.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.7 MB/s | 47 kB 00:00 2023-09-28T00:13:00.036 INFO:teuthology.orchestra.run.smithi026.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 24 MB/s | 559 kB 00:00 2023-09-28T00:13:00.046 INFO:teuthology.orchestra.run.smithi026.stdout:(89/120): thrift-0.13.0-2.el8.x86_64.rpm 6.3 MB/s | 1.7 MB 00:00 2023-09-28T00:13:00.048 INFO:teuthology.orchestra.run.smithi026.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.5 MB/s | 70 kB 00:00 2023-09-28T00:13:00.051 INFO:teuthology.orchestra.run.smithi026.stdout:(91/120): libgfortran-8.4.1-1.el8.x86_64.rpm 18 MB/s | 639 kB 00:00 2023-09-28T00:13:00.067 INFO:teuthology.orchestra.run.smithi026.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 5.2 MB/s | 97 kB 00:00 2023-09-28T00:13:00.083 INFO:teuthology.orchestra.run.smithi026.stdout:(93/120): libselinux-devel-2.9-5.el8.x86_64.rpm 5.4 MB/s | 200 kB 00:00 2023-09-28T00:13:00.084 INFO:teuthology.orchestra.run.smithi026.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.6 MB/s | 44 kB 00:00 2023-09-28T00:13:00.096 INFO:teuthology.orchestra.run.smithi026.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.0 MB/s | 27 kB 00:00 2023-09-28T00:13:00.099 INFO:teuthology.orchestra.run.smithi026.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-09-28T00:13:00.113 INFO:teuthology.orchestra.run.smithi026.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 18 MB/s | 320 kB 00:00 2023-09-28T00:13:00.121 INFO:teuthology.orchestra.run.smithi026.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2023-09-28T00:13:00.137 INFO:teuthology.orchestra.run.smithi026.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.4 MB/s | 39 kB 00:00 2023-09-28T00:13:00.163 INFO:teuthology.orchestra.run.smithi026.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 26 MB/s | 688 kB 00:00 2023-09-28T00:13:00.182 INFO:teuthology.orchestra.run.smithi026.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2023-09-28T00:13:00.207 INFO:teuthology.orchestra.run.smithi026.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 51 MB/s | 4.8 MB 00:00 2023-09-28T00:13:00.211 INFO:teuthology.orchestra.run.smithi026.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 7.6 MB/s | 225 kB 00:00 2023-09-28T00:13:00.228 INFO:teuthology.orchestra.run.smithi026.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.0 MB/s | 126 kB 00:00 2023-09-28T00:13:00.243 INFO:teuthology.orchestra.run.smithi190.stdout:(119/120): librados2-17.2.6-1161.g471b6dfd.el8. 11 MB/s | 3.5 MB 00:00 2023-09-28T00:13:00.247 INFO:teuthology.orchestra.run.smithi026.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 9.9 MB/s | 187 kB 00:00 2023-09-28T00:13:00.364 INFO:teuthology.orchestra.run.smithi026.stdout:(106/120): python3-scipy-1.0.0-20.module+el8.1. 47 MB/s | 15 MB 00:00 2023-09-28T00:13:00.369 INFO:teuthology.orchestra.run.smithi026.stdout:(107/120): python3-jinja2-2.10.1-2.el8_0.noarch 4.3 MB/s | 538 kB 00:00 2023-09-28T00:13:00.392 INFO:teuthology.orchestra.run.smithi026.stdout:(108/120): python3-numpy-1.14.3-9.el8.x86_64.rp 21 MB/s | 3.7 MB 00:00 2023-09-28T00:13:00.394 INFO:teuthology.orchestra.run.smithi026.stdout:(109/120): socat-1.7.3.3-2.el8.x86_64.rpm 9.8 MB/s | 302 kB 00:00 2023-09-28T00:13:00.396 INFO:teuthology.orchestra.run.smithi026.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 5.8 MB/s | 157 kB 00:00 2023-09-28T00:13:00.412 INFO:teuthology.orchestra.run.smithi026.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 5.7 MB/s | 110 kB 00:00 2023-09-28T00:13:00.414 INFO:teuthology.orchestra.run.smithi026.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 18 MB/s | 353 kB 00:00 2023-09-28T00:13:00.418 INFO:teuthology.orchestra.run.smithi026.stdout:(113/120): python3-jsonpointer-1.10-11.el8.noar 903 kB/s | 20 kB 00:00 2023-09-28T00:13:00.440 INFO:teuthology.orchestra.run.smithi026.stdout:(114/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.0 MB/s | 54 kB 00:00 2023-09-28T00:13:00.443 INFO:teuthology.orchestra.run.smithi026.stdout:(115/120): libtool-2.4.6-25.el8.x86_64.rpm 22 MB/s | 709 kB 00:00 2023-09-28T00:13:00.450 INFO:teuthology.orchestra.run.smithi190.stdout:(120/120): librbd1-17.2.6-1161.g471b6dfd.el8.x8 7.0 MB/s | 3.6 MB 00:00 2023-09-28T00:13:00.455 INFO:teuthology.orchestra.run.smithi190.stdout:-------------------------------------------------------------------------------- 2023-09-28T00:13:00.455 INFO:teuthology.orchestra.run.smithi190.stdout:Total 15 MB/s | 201 MB 00:13 2023-09-28T00:13:00.472 INFO:teuthology.orchestra.run.smithi026.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 24 MB/s | 713 kB 00:00 2023-09-28T00:13:00.503 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction check 2023-09-28T00:13:00.509 INFO:teuthology.orchestra.run.smithi026.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 53 MB/s | 4.7 MB 00:00 2023-09-28T00:13:00.538 INFO:teuthology.orchestra.run.smithi026.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 47 MB/s | 4.6 MB 00:00 2023-09-28T00:13:00.617 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction check succeeded. 2023-09-28T00:13:00.617 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction test 2023-09-28T00:13:00.818 INFO:teuthology.orchestra.run.smithi026.stdout:(119/120): librbd1-17.2.6-1161.g471b6dfd.el8.x8 12 MB/s | 3.6 MB 00:00 2023-09-28T00:13:01.237 INFO:teuthology.orchestra.run.smithi026.stdout:(120/120): librados2-17.2.6-1161.g471b6dfd.el8. 4.5 MB/s | 3.5 MB 00:00 2023-09-28T00:13:01.241 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-09-28T00:13:01.242 INFO:teuthology.orchestra.run.smithi026.stdout:Total 18 MB/s | 201 MB 00:11 2023-09-28T00:13:01.295 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2023-09-28T00:13:01.420 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2023-09-28T00:13:01.420 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2023-09-28T00:13:02.686 INFO:teuthology.orchestra.run.smithi190.stdout:Transaction test succeeded. 2023-09-28T00:13:02.690 INFO:teuthology.orchestra.run.smithi190.stdout:Running transaction 2023-09-28T00:13:03.141 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2023-09-28T00:13:03.146 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2023-09-28T00:13:07.554 INFO:teuthology.orchestra.run.smithi190.stdout: Preparing : 1/1 2023-09-28T00:13:07.714 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2023-09-28T00:13:07.792 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-09-28T00:13:07.923 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-09-28T00:13:08.138 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-09-28T00:13:08.272 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-09-28T00:13:08.321 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-09-28T00:13:08.454 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-09-28T00:13:08.843 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-09-28T00:13:09.038 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/122 2023-09-28T00:13:09.245 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-09-28T00:13:09.387 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-09-28T00:13:09.446 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/122 2023-09-28T00:13:09.594 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-09-28T00:13:09.638 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 5/122 2023-09-28T00:13:09.768 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 5/122 2023-09-28T00:13:09.954 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:13:09.992 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-09-28T00:13:10.061 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:13:10.228 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 5/122 2023-09-28T00:13:10.243 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:13:10.605 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-09-28T00:13:10.612 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 5/122 2023-09-28T00:13:10.844 INFO:teuthology.orchestra.run.smithi190.stdout: Upgrading : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:13:10.961 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:13:11.186 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:13:11.295 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-09-28T00:13:11.314 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:13:11.454 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:13:11.596 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:13:11.691 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/122 2023-09-28T00:13:11.834 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-09-28T00:13:11.996 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-09-28T00:13:12.221 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:13:12.324 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:13:12.379 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-09-28T00:13:12.462 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 14/122 2023-09-28T00:13:12.539 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 14/122 2023-09-28T00:13:12.585 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:13:12.696 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:13:12.736 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-09-28T00:13:12.964 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-09-28T00:13:13.151 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-09-28T00:13:13.361 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:13:13.470 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:13:13.495 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-09-28T00:13:13.669 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 14/122 2023-09-28T00:13:13.712 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-09-28T00:13:13.732 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 14/122 2023-09-28T00:13:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-09-28T00:13:13.904 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-09-28T00:13:14.046 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-09-28T00:13:14.052 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-09-28T00:13:14.194 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-09-28T00:13:14.354 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-09-28T00:13:14.422 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-09-28T00:13:14.618 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-09-28T00:13:14.958 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-09-28T00:13:15.129 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-09-28T00:13:15.168 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-09-28T00:13:15.360 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-09-28T00:13:15.677 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-09-28T00:13:15.845 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-09-28T00:13:15.892 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-09-28T00:13:16.118 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-09-28T00:13:16.607 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-09-28T00:13:16.857 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-09-28T00:13:16.858 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-09-28T00:13:17.075 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-09-28T00:13:17.163 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-09-28T00:13:17.318 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-09-28T00:13:17.408 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-09-28T00:13:17.506 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 26/122 2023-09-28T00:13:17.564 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-09-28T00:13:17.641 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 27/122 2023-09-28T00:13:17.832 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-09-28T00:13:17.884 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 28/122 2023-09-28T00:13:18.112 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-09-28T00:13:18.119 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-09-28T00:13:18.364 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-09-28T00:13:18.368 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-09-28T00:13:18.554 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 26/122 2023-09-28T00:13:18.712 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 27/122 2023-09-28T00:13:18.761 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-09-28T00:13:18.975 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 28/122 2023-09-28T00:13:19.995 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-09-28T00:13:20.366 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-09-28T00:13:20.685 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-09-28T00:13:20.942 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-09-28T00:13:20.988 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-09-28T00:13:21.203 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-09-28T00:13:21.314 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-09-28T00:13:21.434 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-09-28T00:13:22.359 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-09-28T00:13:22.717 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-09-28T00:13:22.967 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-09-28T00:13:23.263 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-09-28T00:13:23.457 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-09-28T00:13:23.512 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-09-28T00:13:23.640 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 38/122 2023-09-28T00:13:23.834 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 39/122 2023-09-28T00:13:23.863 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-09-28T00:13:24.107 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 40/122 2023-09-28T00:13:24.123 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-09-28T00:13:24.318 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-09-28T00:13:24.362 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-09-28T00:13:24.494 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-09-28T00:13:24.561 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 38/122 2023-09-28T00:13:24.678 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-09-28T00:13:24.755 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 39/122 2023-09-28T00:13:24.899 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-09-28T00:13:24.998 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 40/122 2023-09-28T00:13:25.077 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-09-28T00:13:25.153 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-09-28T00:13:25.199 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-09-28T00:13:25.321 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-09-28T00:13:25.391 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-09-28T00:13:25.514 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-09-28T00:13:25.552 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-09-28T00:13:25.699 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-09-28T00:13:25.736 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-09-28T00:13:25.868 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-09-28T00:13:25.921 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-09-28T00:13:26.064 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-09-28T00:13:26.090 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-09-28T00:13:26.222 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-09-28T00:13:26.294 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-09-28T00:13:26.367 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-09-28T00:13:26.556 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-09-28T00:13:26.607 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-09-28T00:13:26.733 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-09-28T00:13:26.913 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-09-28T00:13:27.037 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-09-28T00:13:27.179 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-09-28T00:13:27.314 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-09-28T00:13:27.542 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-09-28T00:13:27.611 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-09-28T00:13:27.782 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-09-28T00:13:27.902 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-09-28T00:13:28.007 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-09-28T00:13:28.070 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-09-28T00:13:28.200 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-09-28T00:13:28.250 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-09-28T00:13:28.404 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-09-28T00:13:28.528 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-09-28T00:13:28.591 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-09-28T00:13:28.670 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-09-28T00:13:28.752 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-09-28T00:13:28.866 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-09-28T00:13:28.968 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-09-28T00:13:29.084 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-09-28T00:13:29.137 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-09-28T00:13:29.275 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-09-28T00:13:29.454 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-09-28T00:13:29.691 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-09-28T00:13:29.746 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-09-28T00:13:29.894 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-09-28T00:13:30.045 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-09-28T00:13:30.111 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-09-28T00:13:30.232 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-09-28T00:13:30.310 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-09-28T00:13:30.442 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-09-28T00:13:30.489 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-09-28T00:13:30.659 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-09-28T00:13:30.669 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-09-28T00:13:30.885 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-09-28T00:13:30.893 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-09-28T00:13:31.108 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-09-28T00:13:31.137 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-09-28T00:13:31.342 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-09-28T00:13:31.378 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-09-28T00:13:31.578 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-09-28T00:13:31.640 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-09-28T00:13:31.773 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-09-28T00:13:31.919 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-09-28T00:13:32.033 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-09-28T00:13:32.111 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-09-28T00:13:32.288 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-09-28T00:13:32.349 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-09-28T00:13:32.539 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-09-28T00:13:32.851 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-09-28T00:13:33.132 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-09-28T00:13:33.356 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-09-28T00:13:33.556 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-09-28T00:13:33.615 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-09-28T00:13:33.877 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-09-28T00:13:34.138 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-09-28T00:13:34.468 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-09-28T00:13:34.738 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-09-28T00:13:34.764 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-09-28T00:13:35.092 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-09-28T00:13:35.097 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-09-28T00:13:35.327 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-09-28T00:13:35.409 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-09-28T00:13:35.512 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-09-28T00:13:35.693 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-09-28T00:13:35.780 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-09-28T00:13:36.058 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-09-28T00:13:36.413 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-09-28T00:13:36.641 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-09-28T00:13:36.865 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-09-28T00:13:37.082 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-09-28T00:13:41.182 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:13:41.383 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:13:41.996 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:13:42.245 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:13:42.331 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 88/122 2023-09-28T00:13:42.410 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 88/122 2023-09-28T00:13:42.531 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:13:42.557 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 89/122 2023-09-28T00:13:43.104 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 87/122 2023-09-28T00:13:43.412 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 88/122 2023-09-28T00:13:43.526 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 88/122 2023-09-28T00:13:43.689 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 89/122 2023-09-28T00:14:01.038 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 89/122 2023-09-28T00:14:01.039 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2023-09-28T00:14:01.039 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2023-09-28T00:14:01.039 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-09-28T00:14:01.039 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /run 2023-09-28T00:14:01.039 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2023-09-28T00:14:01.039 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2023-09-28T00:14:01.039 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2023-09-28T00:14:01.039 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2023-09-28T00:14:01.039 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-09-28T00:14:01.040 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 90/122 2023-09-28T00:14:01.588 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 89/122 2023-09-28T00:14:01.588 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /sys 2023-09-28T00:14:01.588 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /proc 2023-09-28T00:14:01.588 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2023-09-28T00:14:01.588 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /run 2023-09-28T00:14:01.589 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /mnt 2023-09-28T00:14:01.589 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /var/tmp 2023-09-28T00:14:01.589 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /home 2023-09-28T00:14:01.589 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /tmp 2023-09-28T00:14:01.589 INFO:teuthology.orchestra.run.smithi190.stdout:skipping the directory /dev 2023-09-28T00:14:01.590 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:02.004 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 90/122 2023-09-28T00:14:02.980 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 90/122 2023-09-28T00:14:03.127 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 91/122 2023-09-28T00:14:03.362 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 91/122 2023-09-28T00:14:03.474 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 90/122 2023-09-28T00:14:03.528 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 92/122 2023-09-28T00:14:03.683 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 91/122 2023-09-28T00:14:03.906 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 91/122 2023-09-28T00:14:03.942 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 92/122 2023-09-28T00:14:04.113 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 93/122 2023-09-28T00:14:04.120 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 92/122 2023-09-28T00:14:04.131 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 93/122 2023-09-28T00:14:04.510 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 92/122 2023-09-28T00:14:04.703 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 93/122 2023-09-28T00:14:04.720 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 93/122 2023-09-28T00:14:07.374 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 94/122 2023-09-28T00:14:07.530 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 94/122 2023-09-28T00:14:07.597 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 94/122 2023-09-28T00:14:07.719 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 95/122 2023-09-28T00:14:07.728 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 94/122 2023-09-28T00:14:07.896 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 96/122 2023-09-28T00:14:07.942 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 95/122 2023-09-28T00:14:08.120 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 97/122 2023-09-28T00:14:08.176 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 96/122 2023-09-28T00:14:08.348 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 97/122 2023-09-28T00:14:08.394 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 97/122 2023-09-28T00:14:08.568 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 98/122 2023-09-28T00:14:08.611 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 97/122 2023-09-28T00:14:08.857 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 98/122 2023-09-28T00:14:09.598 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 98/122 2023-09-28T00:14:09.762 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 99/122 2023-09-28T00:14:09.826 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 98/122 2023-09-28T00:14:09.866 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 99/122 2023-09-28T00:14:10.002 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 99/122 2023-09-28T00:14:10.099 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 99/122 2023-09-28T00:14:10.244 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 100/122 2023-09-28T00:14:10.443 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/122 2023-09-28T00:14:10.457 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 100/122 2023-09-28T00:14:10.482 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/122 2023-09-28T00:14:10.636 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 102/122 2023-09-28T00:14:10.648 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 102/122 2023-09-28T00:14:10.674 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/122 2023-09-28T00:14:10.711 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 101/122 2023-09-28T00:14:10.893 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 102/122 2023-09-28T00:14:10.905 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 102/122 2023-09-28T00:14:12.325 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 103/122 2023-09-28T00:14:12.481 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 103/122 2023-09-28T00:14:12.693 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 104/122 2023-09-28T00:14:12.757 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 104/122 2023-09-28T00:14:12.795 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 104/122 2023-09-28T00:14:12.858 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 104/122 2023-09-28T00:14:12.928 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 105/122 2023-09-28T00:14:12.973 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1161.g471b6 105/122 2023-09-28T00:14:13.043 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 105/122 2023-09-28T00:14:13.086 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1161.g471b6 105/122 2023-09-28T00:14:13.103 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 106/122 2023-09-28T00:14:13.277 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 106/122 2023-09-28T00:14:13.474 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 106/122 2023-09-28T00:14:13.625 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 106/122 2023-09-28T00:14:13.645 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 107/122 2023-09-28T00:14:13.852 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 107/122 2023-09-28T00:14:18.769 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 107/122 2023-09-28T00:14:18.886 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 107/122 2023-09-28T00:14:19.101 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 108/122 2023-09-28T00:14:19.292 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-09-28T00:14:19.887 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 108/122 2023-09-28T00:14:20.001 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-09-28T00:14:20.207 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-09-28T00:14:20.368 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-09-28T00:14:20.389 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 110/122 2023-09-28T00:14:20.587 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 111/122 2023-09-28T00:14:20.745 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-09-28T00:14:20.778 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-09-28T00:14:20.902 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-09-28T00:14:20.913 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-09-28T00:14:20.929 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 113/122 2023-09-28T00:14:21.073 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 113/122 2023-09-28T00:14:21.096 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-09-28T00:14:21.206 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-09-28T00:14:21.283 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 115/122 2023-09-28T00:14:21.402 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 115/122 2023-09-28T00:14:21.474 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 116/122 2023-09-28T00:14:21.594 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 116/122 2023-09-28T00:14:21.685 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 117/122 2023-09-28T00:14:21.834 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 117/122 2023-09-28T00:14:21.928 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-09-28T00:14:22.043 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-09-28T00:14:22.105 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-09-28T00:14:22.166 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-09-28T00:14:22.224 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-09-28T00:14:22.268 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-09-28T00:14:22.278 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-09-28T00:14:22.396 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-09-28T00:14:22.396 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-09-28T00:14:22.416 INFO:teuthology.orchestra.run.smithi190.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-09-28T00:14:22.425 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-09-28T00:14:22.425 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-09-28T00:14:22.622 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-09-28T00:14:22.622 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:14:22.669 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-09-28T00:14:22.669 INFO:teuthology.orchestra.run.smithi190.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:14:23.502 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:14:23.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 1/122 2023-09-28T00:14:23.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2/122 2023-09-28T00:14:23.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 3/122 2023-09-28T00:14:23.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/122 2023-09-28T00:14:23.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 5/122 2023-09-28T00:14:23.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:14:23.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:14:23.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/122 2023-09-28T00:14:23.503 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 11/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 12/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 14/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 15/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 16/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 17/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 19/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 20/122 2023-09-28T00:14:23.504 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 21/122 2023-09-28T00:14:23.505 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 22/122 2023-09-28T00:14:23.505 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 23/122 2023-09-28T00:14:23.505 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 24/122 2023-09-28T00:14:23.505 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 25/122 2023-09-28T00:14:23.505 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 26/122 2023-09-28T00:14:23.505 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 27/122 2023-09-28T00:14:23.505 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 28/122 2023-09-28T00:14:23.505 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 29/122 2023-09-28T00:14:23.505 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 30/122 2023-09-28T00:14:23.516 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 31/122 2023-09-28T00:14:23.516 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 32/122 2023-09-28T00:14:23.516 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 33/122 2023-09-28T00:14:23.516 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 34/122 2023-09-28T00:14:23.516 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 35/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 36/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 37/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 38/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-09-28T00:14:23.517 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-09-28T00:14:23.518 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-09-28T00:14:23.519 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-09-28T00:14:23.520 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-09-28T00:14:23.521 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-09-28T00:14:23.522 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-09-28T00:14:23.523 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-09-28T00:14:23.524 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-09-28T00:14:23.524 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 119/122 2023-09-28T00:14:23.524 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-09-28T00:14:23.524 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 121/122 2023-09-28T00:14:23.585 INFO:teuthology.orchestra.run.smithi190.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:14:23.585 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 1/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 3/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 4/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1161.g471b6 5/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 6/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 7/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 8/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 9/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 10/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 11/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 12/122 2023-09-28T00:14:23.586 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 13/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_ 14/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 15/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 16/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_6 17/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86 18/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 19/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el 20/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8. 21/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_6 22/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 23/122 2023-09-28T00:14:23.587 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 24/122 2023-09-28T00:14:23.588 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 25/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 26/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 27/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 28/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd. 29/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noa 30/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.n 31/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1161.g471 32/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el 33/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 34/122 2023-09-28T00:14:23.596 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.e 35/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 36/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 37/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 38/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-09-28T00:14:23.597 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-09-28T00:14:23.598 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-09-28T00:14:23.599 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-09-28T00:14:23.600 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-09-28T00:14:23.601 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-09-28T00:14:23.601 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-09-28T00:14:23.601 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-09-28T00:14:23.601 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-09-28T00:14:23.601 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-09-28T00:14:23.601 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-09-28T00:14:23.601 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-09-28T00:14:23.601 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-09-28T00:14:23.601 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-09-28T00:14:23.602 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-09-28T00:14:23.603 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 119/122 2023-09-28T00:14:23.604 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-09-28T00:14:23.605 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 121/122 2023-09-28T00:14:25.624 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:14:25.625 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:45 ago on Thu 28 Sep 2023 12:12:40 AM UTC. 2023-09-28T00:14:25.883 INFO:teuthology.orchestra.run.smithi190.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-09-28T00:14:25.883 INFO:teuthology.orchestra.run.smithi190.stdout:Last metadata expiration check: 0:01:47 ago on Thu 28 Sep 2023 12:12:38 AM UTC. 2023-09-28T00:14:27.764 INFO:teuthology.orchestra.run.smithi026.stdout:Installed products updated. 2023-09-28T00:14:27.913 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:27.913 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout: automake-1.16.1-7.el8.noarch 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout: bison-3.0.4-10.el8.x86_64 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.914 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.915 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: flex-2.6.1-9.el8.x86_64 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-2.9.7-12.el8.x86_64 2023-09-28T00:14:27.916 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: jq-1.5-12.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-09-28T00:14:27.917 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-28T00:14:27.918 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.12-1.el8.x86_64 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.5.1-5.el8.noarch 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-28T00:14:27.919 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-28T00:14:27.920 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-28T00:14:27.921 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-2.6-1.el8.noarch 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-28T00:14:27.922 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-28T00:14:27.923 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.924 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.924 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:27.924 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.3.3-2.el8.x86_64 2023-09-28T00:14:27.924 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-28T00:14:27.924 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-09-28T00:14:27.924 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-28T00:14:27.924 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-09-28T00:14:27.924 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:27.925 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-09-28T00:14:27.977 INFO:teuthology.orchestra.run.smithi190.stdout:Installed products updated. 2023-09-28T00:14:28.140 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:28.140 INFO:teuthology.orchestra.run.smithi190.stdout:Upgraded: 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: librados2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: librbd1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout:Installed: 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: automake-1.16.1-7.el8.noarch 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: bison-3.0.4-10.el8.x86_64 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-grafana-dashboards-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.141 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-immutable-object-cache-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mds-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-rook-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mon-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-osd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.142 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-prometheus-alerts-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-radosgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-selinux-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-test-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-volume-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: cephadm-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-top-2:17.2.6-1161.g471b6dfd.el8.noarch 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: flex-2.6.1-9.el8.x86_64 2023-09-28T00:14:28.143 INFO:teuthology.orchestra.run.smithi190.stdout: fuse-2.9.7-12.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: jq-1.5-12.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: libcephfs2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: libcephsqlite-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-09-28T00:14:28.144 INFO:teuthology.orchestra.run.smithi190.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: librados-devel-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: librgw2-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-09-28T00:14:28.145 INFO:teuthology.orchestra.run.smithi190.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-0.3.12-1.el8.x86_64 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-28T00:14:28.146 INFO:teuthology.orchestra.run.smithi190.stdout: python3-babel-2.5.1-5.el8.noarch 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-common-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cephfs-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-28T00:14:28.147 INFO:teuthology.orchestra.run.smithi190.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-28T00:14:28.148 INFO:teuthology.orchestra.run.smithi190.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-portend-2.6-1.el8.noarch 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-28T00:14:28.149 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rgw-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-28T00:14:28.150 INFO:teuthology.orchestra.run.smithi190.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-fuse-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-mirror-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: rbd-nbd-2:17.2.6-1161.g471b6dfd.el8.x86_64 2023-09-28T00:14:28.151 INFO:teuthology.orchestra.run.smithi190.stdout: socat-1.7.3.3-2.el8.x86_64 2023-09-28T00:14:28.152 INFO:teuthology.orchestra.run.smithi190.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-28T00:14:28.152 INFO:teuthology.orchestra.run.smithi190.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-09-28T00:14:28.152 INFO:teuthology.orchestra.run.smithi190.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-28T00:14:28.152 INFO:teuthology.orchestra.run.smithi190.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-09-28T00:14:28.152 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:28.152 INFO:teuthology.orchestra.run.smithi190.stdout:Complete! 2023-09-28T00:14:28.190 DEBUG:teuthology.parallel:result is None 2023-09-28T00:14:28.426 DEBUG:teuthology.parallel:result is None 2023-09-28T00:14:28.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:14:28.586 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-28T00:14:28.607 INFO:teuthology.orchestra.run.smithi026.stdout:17.2.6-1161.g471b6dfd.el8 2023-09-28T00:14:28.608 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1161.g471b6dfd.el8 2023-09-28T00:14:28.608 INFO:teuthology.task.install:The correct ceph version 17.2.6-1161.g471b6dfd is installed. 2023-09-28T00:14:28.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=471b6dfd2d990acf7f03e5d073b84a1b39d1ad28 2023-09-28T00:14:28.825 DEBUG:teuthology.orchestra.run.smithi190:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-28T00:14:28.845 INFO:teuthology.orchestra.run.smithi190.stdout:17.2.6-1161.g471b6dfd.el8 2023-09-28T00:14:28.846 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1161.g471b6dfd.el8 2023-09-28T00:14:28.846 INFO:teuthology.task.install:The correct ceph version 17.2.6-1161.g471b6dfd is installed. 2023-09-28T00:14:28.846 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-28T00:14:28.846 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:28.846 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-28T00:14:28.886 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:14:28.886 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-28T00:14:28.924 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-28T00:14:28.924 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:28.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2023-09-28T00:14:28.950 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-28T00:14:29.015 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:14:29.016 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2023-09-28T00:14:29.040 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-28T00:14:29.103 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-28T00:14:29.104 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:29.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-28T00:14:29.128 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-28T00:14:29.194 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:14:29.194 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-28T00:14:29.220 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-28T00:14:29.284 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-28T00:14:29.285 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:29.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2023-09-28T00:14:29.310 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-28T00:14:29.375 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:14:29.375 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2023-09-28T00:14:29.398 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-28T00:14:29.462 INFO:teuthology.run_tasks:Running task ceph... 2023-09-28T00:14:29.524 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-28T00:14:29.525 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2023-09-28T00:14:29.527 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2023-09-28T00:14:29.550 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-28T00:14:29.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-28T00:14:29.592 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-28T00:14:29.617 INFO:tasks.ceph:Creating extra log directories... 2023-09-28T00:14:29.617 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-28T00:14:29.657 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-28T00:14:29.686 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-28T00:14:29.686 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-28T00:14:29.686 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-28T00:14:29.686 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:29.687 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-28T00:14:29.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-28T00:14:29.847 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-28T00:14:29.872 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:14:29.872 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-28T00:14:29.887 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-28T00:14:29.998 DEBUG:teuthology.orchestra.run.smithi190:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-09-28T00:14:30.028 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-28T00:14:30.028 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-28T00:14:30.028 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488', 'branch': 'wip-yuri-testing-2023-09-27-0906-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7403488', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-09-27-0906-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-09-27-0906-quincy', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3538, 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-09-27-0906-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28', 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH4KRPMJ/Sk11MpERihoceOIMKd4jJGx5Zrw9gESv7h2FwvJXafyFdjEIm3gt4mUYefLPc96cVEPeidgoBgp8jQ=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGW6u61Bh3ClTs4VvujUDiEZq5QElDHaQmn5MJvzH/yWLqQwnjmzlUGNqnIrNpzXPhIntHN3gcG0zope9vy8rY8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '471b6dfd2d990acf7f03e5d073b84a1b39d1ad28'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['fs/quota']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-27_19:23:53', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-28T00:14:30.029 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-28T00:14:30.031 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-28T00:14:30.078 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2023-09-28T00:14:30.086 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2023-09-28T00:14:30.143 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:30.143 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2023-09-28T00:14:30.164 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-28T00:14:30.164 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2023-09-28T00:14:30.219 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-28T00:14:30.219 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:14:30.219 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 219407 Links: 1 2023-09-28T00:14:30.219 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:14:30.220 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:14:30.220 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-09-28 00:14:23.057810493 +0000 2023-09-28T00:14:30.220 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-09-28 00:11:56.105533307 +0000 2023-09-28T00:14:30.220 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-09-28 00:11:56.105533307 +0000 2023-09-28T00:14:30.220 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-09-28T00:14:30.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-28T00:14:30.283 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-09-28T00:14:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-09-28T00:14:30.284 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000123298 s, 4.2 MB/s 2023-09-28T00:14:30.285 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-28T00:14:30.341 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2023-09-28T00:14:30.396 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-28T00:14:30.396 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:14:30.396 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 219597 Links: 1 2023-09-28T00:14:30.397 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:14:30.397 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:14:30.397 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-09-28 00:14:23.057810493 +0000 2023-09-28T00:14:30.397 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-09-28 00:11:56.597526006 +0000 2023-09-28T00:14:30.397 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-09-28 00:11:56.597526006 +0000 2023-09-28T00:14:30.397 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-09-28T00:14:30.398 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-28T00:14:30.460 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-09-28T00:14:30.461 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-09-28T00:14:30.461 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000112258 s, 4.6 MB/s 2023-09-28T00:14:30.462 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-28T00:14:30.519 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2023-09-28T00:14:30.574 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-28T00:14:30.574 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:14:30.574 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 212845 Links: 1 2023-09-28T00:14:30.574 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:14:30.574 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:14:30.574 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-09-28 00:14:23.057810493 +0000 2023-09-28T00:14:30.575 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-09-28 00:11:57.098518572 +0000 2023-09-28T00:14:30.575 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-09-28 00:11:57.098518572 +0000 2023-09-28T00:14:30.575 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-09-28T00:14:30.575 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-28T00:14:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-09-28T00:14:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-09-28T00:14:30.637 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000115484 s, 4.4 MB/s 2023-09-28T00:14:30.638 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-28T00:14:30.695 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2023-09-28T00:14:30.751 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-28T00:14:30.751 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:14:30.751 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 214991 Links: 1 2023-09-28T00:14:30.751 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:14:30.752 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:14:30.752 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-09-28 00:14:23.057810493 +0000 2023-09-28T00:14:30.752 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-09-28 00:11:57.590511275 +0000 2023-09-28T00:14:30.752 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-09-28 00:11:57.590511275 +0000 2023-09-28T00:14:30.752 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-09-28T00:14:30.752 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-28T00:14:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-09-28T00:14:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-09-28T00:14:30.815 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000112188 s, 4.6 MB/s 2023-09-28T00:14:30.816 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-28T00:14:30.872 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:30.873 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:14:30.873 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2023-09-28T00:14:30.889 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-28T00:14:30.889 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2023-09-28T00:14:30.944 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-28T00:14:30.945 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:14:30.945 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 212986 Links: 1 2023-09-28T00:14:30.945 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:14:30.945 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:14:30.945 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-09-28 00:14:23.128729267 +0000 2023-09-28T00:14:30.945 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-09-28 00:11:42.802871052 +0000 2023-09-28T00:14:30.945 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-09-28 00:11:42.802871052 +0000 2023-09-28T00:14:30.945 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-09-28T00:14:30.946 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-28T00:14:31.009 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-09-28T00:14:31.009 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-09-28T00:14:31.009 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000316658 s, 1.6 MB/s 2023-09-28T00:14:31.010 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-28T00:14:31.067 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2023-09-28T00:14:31.122 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-28T00:14:31.122 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:14:31.122 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 218830 Links: 1 2023-09-28T00:14:31.122 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:14:31.122 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:14:31.122 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-09-28 00:14:23.129729239 +0000 2023-09-28T00:14:31.123 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-09-28 00:11:43.293857205 +0000 2023-09-28T00:14:31.123 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-09-28 00:11:43.293857205 +0000 2023-09-28T00:14:31.123 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-09-28T00:14:31.123 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-28T00:14:31.186 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-09-28T00:14:31.187 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-09-28T00:14:31.187 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000208535 s, 2.5 MB/s 2023-09-28T00:14:31.188 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-28T00:14:31.243 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2023-09-28T00:14:31.299 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-28T00:14:31.299 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:14:31.299 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 218055 Links: 1 2023-09-28T00:14:31.299 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:14:31.299 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:14:31.299 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-09-28 00:14:23.129729239 +0000 2023-09-28T00:14:31.299 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-09-28 00:11:43.801842878 +0000 2023-09-28T00:14:31.299 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-09-28 00:11:43.801842878 +0000 2023-09-28T00:14:31.299 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-09-28T00:14:31.300 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-28T00:14:31.361 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-09-28T00:14:31.362 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-09-28T00:14:31.362 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000204692 s, 2.5 MB/s 2023-09-28T00:14:31.363 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-28T00:14:31.418 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2023-09-28T00:14:31.474 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-28T00:14:31.474 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-28T00:14:31.474 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 6h/6d Inode: 221420 Links: 1 2023-09-28T00:14:31.474 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-28T00:14:31.474 INFO:teuthology.orchestra.run.smithi190.stdout:Context: system_u:object_r:device_t:s0 2023-09-28T00:14:31.475 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2023-09-28 00:14:23.129729239 +0000 2023-09-28T00:14:31.475 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2023-09-28 00:11:44.327828043 +0000 2023-09-28T00:14:31.475 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2023-09-28 00:11:44.327828043 +0000 2023-09-28T00:14:31.475 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2023-09-28T00:14:31.475 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-28T00:14:31.536 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2023-09-28T00:14:31.537 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2023-09-28T00:14:31.537 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000208108 s, 2.5 MB/s 2023-09-28T00:14:31.538 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-28T00:14:31.593 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:31.593 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-28T00:14:31.593 INFO:tasks.ceph:Generating config... 2023-09-28T00:14:31.594 INFO:tasks.ceph:[client] client mount timeout = 600 2023-09-28T00:14:31.594 INFO:tasks.ceph:[client] debug client = 20 2023-09-28T00:14:31.595 INFO:tasks.ceph:[client] debug ms = 1 2023-09-28T00:14:31.595 INFO:tasks.ceph:[client] pid file = 2023-09-28T00:14:31.595 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-09-28T00:14:31.595 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-09-28T00:14:31.595 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-09-28T00:14:31.595 INFO:tasks.ceph:[mds] debug mds = 20 2023-09-28T00:14:31.595 INFO:tasks.ceph:[mds] debug ms = 1 2023-09-28T00:14:31.595 INFO:tasks.ceph:[mds] mds debug frag = True 2023-09-28T00:14:31.595 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-09-28T00:14:31.595 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-09-28T00:14:31.595 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-09-28T00:14:31.596 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-09-28T00:14:31.596 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-09-28T00:14:31.596 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-09-28T00:14:31.596 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-28T00:14:31.596 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-28T00:14:31.596 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-28T00:14:31.596 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-28T00:14:31.596 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-28T00:14:31.596 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-09-28T00:14:31.596 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-28T00:14:31.596 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-28T00:14:31.596 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-09-28T00:14:31.596 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-28T00:14:31.596 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-28T00:14:31.597 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-09-28T00:14:31.598 INFO:tasks.ceph:Setting up mon.a... 2023-09-28T00:14:31.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-28T00:14:31.645 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2023-09-28T00:14:31.648 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-28T00:14:31.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T00:14:31.759 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2023-09-28T00:14:31.760 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-09-28T00:14:31.760 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:31.760 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-28T00:14:31.816 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:31.900 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:31.900 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid 8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6 2023-09-28T00:14:31.900 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = octopus 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:fsid 8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2023-09-28T00:14:31.901187+0000 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:created 2023-09-28T00:14:31.901187+0000 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 15 (octopus) 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2023-09-28T00:14:31.901 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-28T00:14:31.902 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-28T00:14:31.918 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6... 2023-09-28T00:14:31.919 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-28T00:14:31.960 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-28T00:14:32.002 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.003 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2023-09-28T00:14:32.004 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.005 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.26,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on skipped message = False 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2023-09-28T00:14:32.006 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.007 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2023-09-28T00:14:32.008 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: bdev async discard = True 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: bdev enable discard = True 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore allocator = bitmap 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 1/20 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 1/20 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 4/10 2023-09-28T00:14:32.009 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-09-28T00:14:32.010 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-09-28T00:14:32.011 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-09-28T00:14:32.011 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-09-28T00:14:32.011 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2023-09-28T00:14:32.011 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.011 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2023-09-28T00:14:32.011 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-09-28T00:14:32.011 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2023-09-28T00:14:32.011 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2023-09-28T00:14:32.011 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2023-09-28T00:14:32.012 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2023-09-28T00:14:32.013 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = "" 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2023-09-28T00:14:32.014 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2023-09-28T00:14:32.015 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2023-09-28T00:14:32.016 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2023-09-28T00:14:32.016 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2023-09-28T00:14:32.016 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2023-09-28T00:14:32.016 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2023-09-28T00:14:32.017 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2023-09-28T00:14:32.017 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2023-09-28T00:14:32.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.019 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-28T00:14:32.020 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2023-09-28T00:14:32.021 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on skipped message = False 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = 8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.022 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2023-09-28T00:14:32.023 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: bdev async discard = True 2023-09-28T00:14:32.024 INFO:teuthology.orchestra.run.smithi026.stdout: bdev enable discard = True 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore allocator = bitmap 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 1/20 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 1/20 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 4/10 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2023-09-28T00:14:32.025 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2023-09-28T00:14:32.026 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2023-09-28T00:14:32.027 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2023-09-28T00:14:32.028 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = "" 2023-09-28T00:14:32.029 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2023-09-28T00:14:32.030 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2023-09-28T00:14:32.031 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2023-09-28T00:14:32.031 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2023-09-28T00:14:32.031 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2023-09-28T00:14:32.031 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2023-09-28T00:14:32.031 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2023-09-28T00:14:32.031 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2023-09-28T00:14:32.031 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-28T00:14:32.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-28T00:14:32.110 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-28T00:14:32.110 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:32.110 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-28T00:14:32.125 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:32.126 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-28T00:14:32.180 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:14:32.181 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:32.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-28T00:14:32.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T00:14:32.256 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:14:32.256 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:32.311 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:14:32.311 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:14:32.311 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-28T00:14:32.311 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-28T00:14:32.345 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:14:32.345 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:32.400 INFO:tasks.ceph:Setting up mon nodes... 2023-09-28T00:14:32.400 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-28T00:14:32.401 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-28T00:14:32.450 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-28T00:14:32.452 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-28T00:14:32.509 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-28T00:14:32.512 INFO:tasks.ceph:Setting up mds nodes... 2023-09-28T00:14:32.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-28T00:14:32.562 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-28T00:14:32.564 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-28T00:14:32.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-28T00:14:32.679 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-28T00:14:32.681 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-28T00:14:32.706 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-28T00:14:32.753 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-28T00:14:32.756 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-28T00:14:32.780 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-09-28T00:14:32.868 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-09-28T00:14:32.870 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-09-28T00:14:32.894 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-28T00:14:32.894 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-28T00:14:32.933 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-28T00:14:32.946 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-09-28T00:14:33.025 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-09-28T00:14:33.038 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-28T00:14:33.075 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-28T00:14:33.087 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-09-28T00:14:33.165 INFO:teuthology.orchestra.run.smithi190.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-09-28T00:14:33.177 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-28T00:14:33.177 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-09-28T00:14:33.177 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-28T00:14:33.203 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:33.203 INFO:tasks.ceph:role: osd.0 2023-09-28T00:14:33.203 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:14:33.204 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-28T00:14:33.268 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:14:33.268 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:14:33.269 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:14:33.269 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2023-09-28T00:14:33.269 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:14:33.269 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:14:33.269 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:14:33.269 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:14:33.269 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:14:33.269 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:14:33.291 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-09-28T00:14:33.292 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-09-28T00:14:33.293 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-28T00:14:33.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-28T00:14:33.442 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-28T00:14:33.508 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:33.508 INFO:tasks.ceph:role: osd.1 2023-09-28T00:14:33.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:14:33.509 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-28T00:14:33.574 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:14:33.574 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:14:33.574 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:14:33.574 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2023-09-28T00:14:33.574 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:14:33.574 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:14:33.574 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:14:33.575 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:14:33.575 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:14:33.575 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:14:33.597 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-09-28T00:14:33.598 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-09-28T00:14:33.599 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-09-28T00:14:33.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-28T00:14:33.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-28T00:14:33.810 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:33.810 INFO:tasks.ceph:role: osd.2 2023-09-28T00:14:33.810 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:14:33.811 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-28T00:14:33.875 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:14:33.875 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:14:33.875 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:14:33.875 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2023-09-28T00:14:33.876 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:14:33.876 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:14:33.876 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:14:33.876 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:14:33.876 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:14:33.876 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:14:33.898 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-09-28T00:14:33.899 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-09-28T00:14:33.899 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-09-28T00:14:33.978 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-28T00:14:34.046 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-28T00:14:34.112 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:34.112 INFO:tasks.ceph:role: osd.3 2023-09-28T00:14:34.112 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:14:34.112 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-28T00:14:34.176 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:14:34.176 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:14:34.176 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:14:34.176 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 2023-09-28T00:14:34.176 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:14:34.176 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:14:34.176 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:14:34.177 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:14:34.177 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:14:34.177 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:14:34.198 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2023-09-28T00:14:34.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2023-09-28T00:14:34.200 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-09-28T00:14:34.278 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-28T00:14:34.346 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:34.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:34.447+0000 7f334a9b2540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-28T00:14:34.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:34.447+0000 7f334a9b2540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-28T00:14:34.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:34.447+0000 7f334a9b2540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T00:14:34.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:34.447+0000 7f334a9b2540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T00:14:34.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:34.447+0000 7f334a9b2540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-28T00:14:34.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:34.447+0000 7f334a9b2540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-28T00:14:34.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:34.969+0000 7f334a9b2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:35.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:35.732+0000 7f334a9b2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:36.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:36.495+0000 7f334a9b2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:37.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-28T00:14:37.320 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:37.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:37.406+0000 7f5a66a3e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-28T00:14:37.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:37.406+0000 7f5a66a3e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-28T00:14:37.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:37.406+0000 7f5a66a3e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T00:14:37.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:37.406+0000 7f5a66a3e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T00:14:37.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:37.406+0000 7f5a66a3e540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-28T00:14:37.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:37.406+0000 7f5a66a3e540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-28T00:14:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:37.929+0000 7f5a66a3e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:38.693+0000 7f5a66a3e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:39.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:39.456+0000 7f5a66a3e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:40.253 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-28T00:14:40.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:40.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:40.368+0000 7f1714796540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-28T00:14:40.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:40.369+0000 7f1714796540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-28T00:14:40.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:40.369+0000 7f1714796540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T00:14:40.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:40.369+0000 7f1714796540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T00:14:40.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:40.369+0000 7f1714796540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-28T00:14:40.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:40.369+0000 7f1714796540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-28T00:14:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:40.893+0000 7f1714796540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:41.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:41.653+0000 7f1714796540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:42.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:42.446+0000 7f1714796540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:43.212 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-28T00:14:43.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:43.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:43.331+0000 7f4b6c3ac540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-28T00:14:43.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:43.331+0000 7f4b6c3ac540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-28T00:14:43.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:43.331+0000 7f4b6c3ac540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-28T00:14:43.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:43.331+0000 7f4b6c3ac540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-28T00:14:43.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:43.331+0000 7f4b6c3ac540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-28T00:14:43.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:43.332+0000 7f4b6c3ac540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-28T00:14:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:43.853+0000 7f4b6c3ac540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:44.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:44.616+0000 7f4b6c3ac540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:45.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:14:45.382+0000 7f4b6c3ac540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:46.175 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-28T00:14:46.205 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-09-28T00:14:46.234 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:46.234 INFO:tasks.ceph:role: osd.4 2023-09-28T00:14:46.234 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:14:46.234 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-28T00:14:46.307 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:14:46.307 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:14:46.307 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:14:46.307 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2023-09-28T00:14:46.307 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:14:46.307 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:14:46.307 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:14:46.307 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:14:46.308 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:14:46.308 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:14:46.742 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-09-28T00:14:46.743 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-09-28T00:14:46.744 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-09-28T00:14:46.894 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-09-28T00:14:46.929 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-09-28T00:14:46.997 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:46.997 INFO:tasks.ceph:role: osd.5 2023-09-28T00:14:46.997 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:14:46.998 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-28T00:14:47.070 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:14:47.071 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:14:47.071 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:14:47.071 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2023-09-28T00:14:47.071 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:14:47.071 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:14:47.071 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:14:47.071 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:14:47.072 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:14:47.072 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:14:47.494 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-09-28T00:14:47.496 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-09-28T00:14:47.496 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-09-28T00:14:47.611 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-09-28T00:14:47.641 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-09-28T00:14:47.707 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:47.707 INFO:tasks.ceph:role: osd.6 2023-09-28T00:14:47.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:14:47.708 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-28T00:14:47.780 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:14:47.780 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:14:47.781 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:14:47.781 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2023-09-28T00:14:47.781 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:14:47.781 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:14:47.781 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:14:47.781 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:14:47.781 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:14:47.781 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:14:48.226 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-09-28T00:14:48.228 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-09-28T00:14:48.229 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-09-28T00:14:48.393 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-09-28T00:14:48.425 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-09-28T00:14:48.492 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-09-28T00:14:48.492 INFO:tasks.ceph:role: osd.7 2023-09-28T00:14:48.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:14:48.492 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-09-28T00:14:48.566 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-09-28T00:14:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-28T00:14:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-28T00:14:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 2023-09-28T00:14:48.566 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-28T00:14:48.566 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2023-09-28T00:14:48.566 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-28T00:14:48.567 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-28T00:14:48.567 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-28T00:14:48.567 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-28T00:14:49.016 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2023-09-28T00:14:49.019 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2023-09-28T00:14:49.019 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-09-28T00:14:49.208 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-09-28T00:14:49.243 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:49.378 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:49.378+0000 7f88ff231540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-09-28T00:14:49.379 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:49.378+0000 7f88ff231540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-09-28T00:14:49.379 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:49.378+0000 7f88ff231540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-28T00:14:49.379 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:49.378+0000 7f88ff231540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-28T00:14:49.379 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:49.378+0000 7f88ff231540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-09-28T00:14:49.379 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:49.379+0000 7f88ff231540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-09-28T00:14:49.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:49.900+0000 7f88ff231540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:50.668 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:50.668+0000 7f88ff231540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:51.430 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:51.429+0000 7f88ff231540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:52.222 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-09-28T00:14:52.249 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:52.332 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:52.331+0000 7f87b0a74540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-09-28T00:14:52.333 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:52.331+0000 7f87b0a74540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-09-28T00:14:52.333 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:52.331+0000 7f87b0a74540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-28T00:14:52.334 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:52.331+0000 7f87b0a74540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-28T00:14:52.334 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:52.331+0000 7f87b0a74540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-09-28T00:14:52.334 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:52.331+0000 7f87b0a74540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-09-28T00:14:52.866 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:52.865+0000 7f87b0a74540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:53.628 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:53.628+0000 7f87b0a74540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:54.391 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:54.390+0000 7f87b0a74540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:55.185 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-09-28T00:14:55.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:55.339 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:55.338+0000 7f554160e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-09-28T00:14:55.339 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:55.338+0000 7f554160e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-09-28T00:14:55.339 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:55.338+0000 7f554160e540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-28T00:14:55.340 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:55.338+0000 7f554160e540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-28T00:14:55.340 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:55.338+0000 7f554160e540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-09-28T00:14:55.340 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:55.339+0000 7f554160e540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-09-28T00:14:55.864 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:55.863+0000 7f554160e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:56.631 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:56.630+0000 7f554160e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:57.393 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:57.392+0000 7f554160e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:58.184 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-09-28T00:14:58.210 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:14:58.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:58.292+0000 7f01e973e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-09-28T00:14:58.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:58.292+0000 7f01e973e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-09-28T00:14:58.293 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:58.292+0000 7f01e973e540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-28T00:14:58.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:58.292+0000 7f01e973e540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-28T00:14:58.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:58.292+0000 7f01e973e540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-09-28T00:14:58.294 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:58.293+0000 7f01e973e540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-09-28T00:14:58.819 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:58.818+0000 7f01e973e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:14:59.581 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:14:59.581+0000 7f01e973e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:15:00.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:15:00.033 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:15:00.345 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:00.344+0000 7f01e973e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-28T00:15:01.140 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-09-28T00:15:01.167 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-28T00:15:01.167 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:01.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-28T00:15:01.195 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:01.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-28T00:15:01.263 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:01.263 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-28T00:15:01.329 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:01.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-28T00:15:01.396 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:01.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-28T00:15:01.462 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:01.462 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-28T00:15:01.527 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:01.527 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-28T00:15:01.592 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:01.592 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-28T00:15:01.621 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:01.621 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-28T00:15:01.689 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:01.689 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-09-28T00:15:01.756 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:01.756 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-09-28T00:15:01.822 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:01.822 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-09-28T00:15:01.888 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:01.888 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-09-28T00:15:01.952 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:01.952 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-09-28T00:15:02.016 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:02.017 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-28T00:15:02.033 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:02.034 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-09-28T00:15:02.090 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:02.090 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-28T00:15:02.105 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:02.105 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-09-28T00:15:02.160 INFO:tasks.ceph:Adding keys to all mons... 2023-09-28T00:15:02.161 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-28T00:15:02.163 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-28T00:15:02.203 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBoxRRlQLreGhAATNGzdpI+ulrX9c+AeEF5DQ== 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBoxRRlbzaMIRAABNAE0MZ6DS8FM/XJJiK6nA== 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBoxRRltkqGKBAAENn8VFMPuzYhE/mYSA5pDg== 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBqxRRl3R6/GhAAWfI7nhr6wIfV8yjDfe/3HQ== 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBtxRRlF2lKGBAAjOADYvlghOlXptZjkoAo0A== 2023-09-28T00:15:02.204 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBwxRRl2NcTFhAA6loalAONa6O0yaPvP21Yxg== 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBzxRRlEdTZExAA5s+EAJlQb1KuJxTSmJDhWw== 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBoxRRlfMxuHhAAC5fmzzJkA1xYyHCidBFX5g== 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBoxRRlemr6LBAATaVZy+f8D8VawYBdzLSW3g== 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBoxRRlfubKMxAAlGXDuJZmPL8UMEOPjQvIgQ== 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB5xRRl0sSTFhAA29cch3lEl6DS1zY8HiDsrw== 2023-09-28T00:15:02.205 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB8xRRlE4bTExAAXZZJItEABQZwl26R0x+2NQ== 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB/xRRl5idAFBAAm9IXXcAfps+uP6bELzf2lQ== 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQCCxRRlkiiCERAAG0EScAku+6obx9E+4kOiKg== 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBoxRRlSNetNxAA4BR//vwMn2NKs/ERSA9QHg== 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout:[client.2] 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBpxRRlP42HARAA3NHFBApSufn+JQrgwr2phg== 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout:[client.1] 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBpxRRlZESJBBAAmf2LbXCY0IkWUwrpXNvU1A== 2023-09-28T00:15:02.206 INFO:teuthology.orchestra.run.smithi026.stdout:[client.3] 2023-09-28T00:15:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBpxRRl9zviCRAAq7Ierhiwiac16BhEyRg3UQ== 2023-09-28T00:15:02.223 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBoxRRlQLreGhAATNGzdpI+ulrX9c+AeEF5DQ== 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBoxRRlbzaMIRAABNAE0MZ6DS8FM/XJJiK6nA== 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBoxRRltkqGKBAAENn8VFMPuzYhE/mYSA5pDg== 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBqxRRl3R6/GhAAWfI7nhr6wIfV8yjDfe/3HQ== 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBtxRRlF2lKGBAAjOADYvlghOlXptZjkoAo0A== 2023-09-28T00:15:02.224 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBwxRRl2NcTFhAA6loalAONa6O0yaPvP21Yxg== 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBzxRRlEdTZExAA5s+EAJlQb1KuJxTSmJDhWw== 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBoxRRlfMxuHhAAC5fmzzJkA1xYyHCidBFX5g== 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBoxRRlemr6LBAATaVZy+f8D8VawYBdzLSW3g== 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBoxRRlfubKMxAAlGXDuJZmPL8UMEOPjQvIgQ== 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQB5xRRl0sSTFhAA29cch3lEl6DS1zY8HiDsrw== 2023-09-28T00:15:02.225 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2023-09-28T00:15:02.226 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQB8xRRlE4bTExAAXZZJItEABQZwl26R0x+2NQ== 2023-09-28T00:15:02.226 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2023-09-28T00:15:02.226 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQB/xRRl5idAFBAAm9IXXcAfps+uP6bELzf2lQ== 2023-09-28T00:15:02.226 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2023-09-28T00:15:02.226 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQCCxRRlkiiCERAAG0EScAku+6obx9E+4kOiKg== 2023-09-28T00:15:02.226 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2023-09-28T00:15:02.227 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBoxRRlSNetNxAA4BR//vwMn2NKs/ERSA9QHg== 2023-09-28T00:15:02.227 INFO:teuthology.orchestra.run.smithi190.stdout:[client.2] 2023-09-28T00:15:02.227 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBpxRRlP42HARAA3NHFBApSufn+JQrgwr2phg== 2023-09-28T00:15:02.227 INFO:teuthology.orchestra.run.smithi190.stdout:[client.1] 2023-09-28T00:15:02.227 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBpxRRlZESJBBAAmf2LbXCY0IkWUwrpXNvU1A== 2023-09-28T00:15:02.227 INFO:teuthology.orchestra.run.smithi190.stdout:[client.3] 2023-09-28T00:15:02.227 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBpxRRl9zviCRAAq7Ierhiwiac16BhEyRg3UQ== 2023-09-28T00:15:02.228 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T00:15:02.250 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T00:15:02.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:15:02.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:15:02.370 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:15:02.373 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:15:02.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.425 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.472 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.474 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.521 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.524 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.570 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.573 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T00:15:02.622 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-28T00:15:02.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:15:02.671 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:15:02.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:15:02.723 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-28T00:15:02.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.775 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.822 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.824 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.875 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.923 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.926 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-28T00:15:02.974 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:15:02.977 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:15:03.027 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:15:03.030 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:15:03.080 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:15:03.084 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:15:03.134 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:15:03.136 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-28T00:15:03.185 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-28T00:15:03.186 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-28T00:15:03.210 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T00:15:03.304 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-28T00:15:03.328 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-28T00:15:03.353 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T00:15:03.443 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-28T00:15:03.468 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-28T00:15:03.532 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-28T00:15:03.624 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-28T00:15:03.647 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:15:03.650 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-28T00:15:03.702 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-28T00:15:03.703 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-28T00:15:03.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-28T00:15:03.706 INFO:tasks.ceph.mon.a:Started 2023-09-28T00:15:03.706 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-28T00:15:03.706 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-28T00:15:03.745 INFO:tasks.ceph.mon.b:Started 2023-09-28T00:15:03.745 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-28T00:15:03.745 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-28T00:15:03.747 INFO:tasks.ceph.mon.c:Started 2023-09-28T00:15:03.747 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-28T00:15:03.747 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-28T00:15:03.747 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-28T00:15:03.750 INFO:tasks.ceph.mgr.y:Started 2023-09-28T00:15:03.750 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-28T00:15:03.750 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-28T00:15:03.752 INFO:tasks.ceph.mgr.x:Started 2023-09-28T00:15:03.752 INFO:tasks.ceph:Setting crush tunables to default 2023-09-28T00:15:03.752 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2023-09-28T00:15:03.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.872+0000 7ff42fab0700 1 Processor -- start 2023-09-28T00:15:03.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.873+0000 7ff42fab0700 1 -- start start 2023-09-28T00:15:03.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.873+0000 7ff42fab0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff428159500 0x7ff4281598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:03.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.873+0000 7ff42fab0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff4280b3fd0 0x7ff42815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:03.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.873+0000 7ff42fab0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42815dd20 con 0x7ff42815d8e0 2023-09-28T00:15:03.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.873+0000 7ff42fab0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4280b1110 con 0x7ff428159500 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.873+0000 7ff42fab0700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4280b13b0 con 0x7ff4280b3fd0 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.873+0000 7ff42d84c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff428159500 0x7ff4281598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d84c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff428159500 0x7ff4281598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57228/0 (socket says 172.21.15.26:57228) 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d84c700 1 -- 172.21.15.26:0/2103119302 learned_addr learned my addr 172.21.15.26:0/2103119302 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d84c700 1 -- 172.21.15.26:0/2103119302 >> v2:172.21.15.26:3300/0 conn(0x7ff428159500 msgr2=0x7ff4281598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d84c700 1 -- 172.21.15.26:0/2103119302 >> v2:172.21.15.26:3300/0 conn(0x7ff428159500 msgr2=0x7ff4281598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d84c700 1 --2- 172.21.15.26:0/2103119302 >> v2:172.21.15.26:3300/0 conn(0x7ff428159500 0x7ff4281598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d04b700 1 --2- 172.21.15.26:0/2103119302 >> v2:172.21.15.190:3300/0 conn(0x7ff4280b3fd0 0x7ff42815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d84c700 1 --2- 172.21.15.26:0/2103119302 >> v2:172.21.15.26:3300/0 conn(0x7ff428159500 0x7ff4281598d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d04b700 1 -- 172.21.15.26:0/2103119302 >> v2:172.21.15.190:3300/0 conn(0x7ff4280b3fd0 msgr2=0x7ff42815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-28T00:15:03.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d04b700 1 -- 172.21.15.26:0/2103119302 >> v2:172.21.15.190:3300/0 conn(0x7ff4280b3fd0 msgr2=0x7ff42815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-28T00:15:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d04b700 1 --2- 172.21.15.26:0/2103119302 >> v2:172.21.15.190:3300/0 conn(0x7ff4280b3fd0 0x7ff42815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-28T00:15:03.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:03.874+0000 7ff42d04b700 1 --2- 172.21.15.26:0/2103119302 >> v2:172.21.15.190:3300/0 conn(0x7ff4280b3fd0 0x7ff42815d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-28T00:15:04.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.065+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319366916 0 0) 0x7ff42815dd20 con 0x7ff42815d8e0 2023-09-28T00:15:04.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.065+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff414003570 con 0x7ff42815d8e0 2023-09-28T00:15:04.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2994404284 0 0) 0x7ff414003570 con 0x7ff42815d8e0 2023-09-28T00:15:04.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 >> v2:172.21.15.190:3300/0 conn(0x7ff4280b3fd0 msgr2=0x7ff42815d3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:15:04.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 --2- 172.21.15.26:0/2103119302 >> v2:172.21.15.190:3300/0 conn(0x7ff4280b3fd0 0x7ff42815d3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 >> v2:172.21.15.26:3300/0 conn(0x7ff428159500 msgr2=0x7ff4281598d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 --2- 172.21.15.26:0/2103119302 >> v2:172.21.15.26:3300/0 conn(0x7ff428159500 0x7ff4281598d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4280b1690 con 0x7ff42815d8e0 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7ff4200017f0 con 0x7ff42815d8e0 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 >> v1:172.21.15.190:6789/0 conn(0x7ff42815d8e0 legacy=0x7ff4280cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff414003a60 0x7ff414003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff414004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4140051c0 0x7ff41400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280b1110 con 0x7ff414004810 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.066+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280b13b0 con 0x7ff4140051c0 2023-09-28T00:15:04.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41400c130 con 0x7ff414003a60 2023-09-28T00:15:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42d04b700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff414004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42d84c700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff414003a60 0x7ff414003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42e04d700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4140051c0 0x7ff41400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42d04b700 1 -- 172.21.15.26:0/2103119302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff414003a60 msgr2=0x7ff414003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42d04b700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff414003a60 0x7ff414003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42d04b700 1 -- 172.21.15.26:0/2103119302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4140051c0 msgr2=0x7ff41400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42d04b700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff4140051c0 0x7ff41400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42e04d700 1 -- 172.21.15.26:0/2103119302 reap_dead start 2023-09-28T00:15:04.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42d04b700 1 -- 172.21.15.26:0/2103119302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff414003570 con 0x7ff414004810 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42d04b700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff414004c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff42400bb40 tx=0x7ff424008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abd946f7dc2b648 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424018070 con 0x7ff414004810 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400d5d0 con 0x7ff414004810 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.067+0000 7ff42c84a700 1 -- 172.21.15.26:0/2103119302 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400d990 con 0x7ff414004810 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.068+0000 7ff42fab0700 1 -- 172.21.15.26:0/2103119302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 msgr2=0x7ff414004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.068+0000 7ff42fab0700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff414004c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff42400bb40 tx=0x7ff424008040 comp rx=0 tx=0).stop 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.068+0000 7ff42fab0700 1 -- 172.21.15.26:0/2103119302 shutdown_connections 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.068+0000 7ff42fab0700 1 --2- 172.21.15.26:0/2103119302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff414004c80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.068+0000 7ff42fab0700 1 -- 172.21.15.26:0/2103119302 >> 172.21.15.26:0/2103119302 conn(0x7ff428067630 msgr2=0x7ff428069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:04.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.068+0000 7ff42fab0700 1 -- 172.21.15.26:0/2103119302 shutdown_connections 2023-09-28T00:15:04.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.068+0000 7ff42fab0700 1 -- 172.21.15.26:0/2103119302 wait complete. 2023-09-28T00:15:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.070+0000 7ff42fab0700 1 Processor -- start 2023-09-28T00:15:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.070+0000 7ff42fab0700 1 -- start start 2023-09-28T00:15:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.070+0000 7ff42fab0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff428169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.070+0000 7ff42fab0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff42815b760 0x7ff42815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.070+0000 7ff42fab0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff42816d510 0x7ff42816c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.070+0000 7ff42fab0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428152ef0 con 0x7ff414004810 2023-09-28T00:15:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.070+0000 7ff42fab0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428150d20 con 0x7ff42815b760 2023-09-28T00:15:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.070+0000 7ff42fab0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff428150110 con 0x7ff42816d510 2023-09-28T00:15:04.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d84c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff428169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d84c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff428169e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57262/0 (socket says 172.21.15.26:57262) 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d84c700 1 -- 172.21.15.26:0/576967572 learned_addr learned my addr 172.21.15.26:0/576967572 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d04b700 1 --2- 172.21.15.26:0/576967572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff42815b760 0x7ff42815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42e04d700 1 --2- 172.21.15.26:0/576967572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff42816d510 0x7ff42816c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d84c700 1 -- 172.21.15.26:0/576967572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff42816d510 msgr2=0x7ff42816c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d84c700 1 --2- 172.21.15.26:0/576967572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff42816d510 0x7ff42816c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d84c700 1 -- 172.21.15.26:0/576967572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff42815b760 msgr2=0x7ff42815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d84c700 1 --2- 172.21.15.26:0/576967572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff42815b760 0x7ff42815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d84c700 1 -- 172.21.15.26:0/576967572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4281503f0 con 0x7ff414004810 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42d84c700 1 --2- 172.21.15.26:0/576967572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff428169e00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff41c011780 tx=0x7ff41c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff419ffb700 1 -- 172.21.15.26:0/576967572 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c00c070 con 0x7ff414004810 2023-09-28T00:15:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff419ffb700 1 -- 172.21.15.26:0/576967572 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c015670 con 0x7ff414004810 2023-09-28T00:15:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42fab0700 1 -- 172.21.15.26:0/576967572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4281506d0 con 0x7ff414004810 2023-09-28T00:15:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff419ffb700 1 -- 172.21.15.26:0/576967572 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c015a30 con 0x7ff414004810 2023-09-28T00:15:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.071+0000 7ff42fab0700 1 -- 172.21.15.26:0/576967572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42815c0f0 con 0x7ff414004810 2023-09-28T00:15:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.072+0000 7ff419ffb700 1 -- 172.21.15.26:0/576967572 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff41c01e6d0 con 0x7ff414004810 2023-09-28T00:15:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.072+0000 7ff419ffb700 1 -- 172.21.15.26:0/576967572 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff41c013760 con 0x7ff414004810 2023-09-28T00:15:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.072+0000 7ff42fab0700 1 -- 172.21.15.26:0/576967572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff428064050 con 0x7ff414004810 2023-09-28T00:15:04.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.074+0000 7ff419ffb700 1 -- 172.21.15.26:0/576967572 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7ff41c023060 con 0x7ff414004810 2023-09-28T00:15:04.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.151+0000 7ff42fab0700 1 -- 172.21.15.26:0/576967572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff4280b1970 con 0x7ff414004810 2023-09-28T00:15:04.153 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.154+0000 7ff419ffb700 1 -- 172.21.15.26:0/576967572 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff41c019070 con 0x7ff414004810 2023-09-28T00:15:04.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.155+0000 7ff42fab0700 1 -- 172.21.15.26:0/576967572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 msgr2=0x7ff428169e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.155+0000 7ff42fab0700 1 --2- 172.21.15.26:0/576967572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff428169e00 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff41c011780 tx=0x7ff41c008040 comp rx=0 tx=0).stop 2023-09-28T00:15:04.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.155+0000 7ff42fab0700 1 -- 172.21.15.26:0/576967572 shutdown_connections 2023-09-28T00:15:04.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.155+0000 7ff42fab0700 1 --2- 172.21.15.26:0/576967572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff42816d510 0x7ff42816c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.155+0000 7ff42fab0700 1 --2- 172.21.15.26:0/576967572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff414004810 0x7ff428169e00 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.155+0000 7ff42fab0700 1 --2- 172.21.15.26:0/576967572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff42815b760 0x7ff42815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.155+0000 7ff42fab0700 1 -- 172.21.15.26:0/576967572 >> 172.21.15.26:0/576967572 conn(0x7ff428067630 msgr2=0x7ff42814d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:04.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.155+0000 7ff42fab0700 1 -- 172.21.15.26:0/576967572 shutdown_connections 2023-09-28T00:15:04.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:04.155+0000 7ff42fab0700 1 -- 172.21.15.26:0/576967572 wait complete. 2023-09-28T00:15:04.156 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2023-09-28T00:15:04.167 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-28T00:15:04.167 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:04.167 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-28T00:15:04.192 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:04.192 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-28T00:15:04.257 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:04.257 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-28T00:15:04.322 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-09-28T00:15:04.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-28T00:15:04.388 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:04.388 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-09-28T00:15:04.412 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:04.413 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-09-28T00:15:04.477 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:04.477 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-09-28T00:15:04.542 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2023-09-28T00:15:04.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-09-28T00:15:04.606 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8 0 2023-09-28T00:15:04.761 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.760+0000 7f92398db700 1 Processor -- start 2023-09-28T00:15:04.761 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.760+0000 7f92398db700 1 -- start start 2023-09-28T00:15:04.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f92398db700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9234142ec0 0x7f92340b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f92398db700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923406f3b0 0x7f9234163490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f92398db700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92340add70 con 0x7f92340b0640 2023-09-28T00:15:04.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f92398db700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92340ae050 con 0x7f9234142ec0 2023-09-28T00:15:04.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f92398db700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92340c95a0 con 0x7f923406f3b0 2023-09-28T00:15:04.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f9232ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9234142ec0 0x7f92340b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f92337fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923406f3b0 0x7f9234163490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f9232ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9234142ec0 0x7f92340b0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58976/0 (socket says 172.21.15.190:58976) 2023-09-28T00:15:04.764 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f92327fc700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f92340b0640 0x7f923406eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:56634/0 (socket says 172.21.15.190:56634) 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f9232ffd700 1 -- 172.21.15.190:0/3515428370 learned_addr learned my addr 172.21.15.190:0/3515428370 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f92337fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923406f3b0 0x7f9234163490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50306/0 (socket says 172.21.15.190:50306) 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.761+0000 7f9232ffd700 1 -- 172.21.15.190:0/3515428370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923406f3b0 msgr2=0x7f9234163490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f9232ffd700 1 --2- 172.21.15.190:0/3515428370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923406f3b0 0x7f9234163490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f9232ffd700 1 -- 172.21.15.190:0/3515428370 >> v1:172.21.15.190:6789/0 conn(0x7f92340b0640 legacy=0x7f923406eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f9232ffd700 1 -- 172.21.15.190:0/3515428370 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92340b0c70 con 0x7f9234142ec0 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f92337fe700 1 --2- 172.21.15.190:0/3515428370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923406f3b0 0x7f9234163490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f9232ffd700 1 --2- 172.21.15.190:0/3515428370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9234142ec0 0x7f92340b0100 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f92280099b0 tx=0x7f9228009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d552cd4109012ab server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f9231ffb700 1 -- 172.21.15.190:0/3515428370 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9228009ea0 con 0x7f9234142ec0 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f9231ffb700 1 -- 172.21.15.190:0/3515428370 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922800b860 con 0x7f9234142ec0 2023-09-28T00:15:04.765 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f9231ffb700 1 -- 172.21.15.190:0/3515428370 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922800bc00 con 0x7f9234142ec0 2023-09-28T00:15:04.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f92398db700 1 -- 172.21.15.190:0/3515428370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9234142ec0 msgr2=0x7f92340b0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f92398db700 1 --2- 172.21.15.190:0/3515428370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9234142ec0 0x7f92340b0100 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f92280099b0 tx=0x7f9228009250 comp rx=0 tx=0).stop 2023-09-28T00:15:04.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f92398db700 1 -- 172.21.15.190:0/3515428370 shutdown_connections 2023-09-28T00:15:04.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f92398db700 1 --2- 172.21.15.190:0/3515428370 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f923406f3b0 0x7f9234163490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f92398db700 1 --2- 172.21.15.190:0/3515428370 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9234142ec0 0x7f92340b0100 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f92398db700 1 -- 172.21.15.190:0/3515428370 >> 172.21.15.190:0/3515428370 conn(0x7f92340ca740 msgr2=0x7f923406e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:04.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f92398db700 1 -- 172.21.15.190:0/3515428370 shutdown_connections 2023-09-28T00:15:04.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.762+0000 7f92398db700 1 -- 172.21.15.190:0/3515428370 wait complete. 2023-09-28T00:15:04.768 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.764+0000 7f92398db700 1 Processor -- start 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.764+0000 7f92398db700 1 -- start start 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.764+0000 7f92398db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f923406f3b0 0x7f923412e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.764+0000 7f92398db700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92340b0640 0x7f92340aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.764+0000 7f92398db700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9234142ec0 0x7f9234133b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.764+0000 7f92398db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923412f9b0 con 0x7f923406f3b0 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.764+0000 7f92398db700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92340abfd0 con 0x7f92340b0640 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.764+0000 7f92398db700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923412eda0 con 0x7f9234142ec0 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92327fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92340b0640 0x7f92340aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92337fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9234142ec0 0x7f9234133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92327fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92340b0640 0x7f92340aba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58984/0 (socket says 172.21.15.190:58984) 2023-09-28T00:15:04.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92327fc700 1 -- 172.21.15.190:0/1789563947 learned_addr learned my addr 172.21.15.190:0/1789563947 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f9232ffd700 1 --2- 172.21.15.190:0/1789563947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f923406f3b0 0x7f923412e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92327fc700 1 -- 172.21.15.190:0/1789563947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9234142ec0 msgr2=0x7f9234133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92327fc700 1 --2- 172.21.15.190:0/1789563947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9234142ec0 0x7f9234133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92327fc700 1 -- 172.21.15.190:0/1789563947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f923406f3b0 msgr2=0x7f923412e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92327fc700 1 --2- 172.21.15.190:0/1789563947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f923406f3b0 0x7f923412e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92327fc700 1 -- 172.21.15.190:0/1789563947 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c009a20 con 0x7f92340b0640 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f9232ffd700 1 --2- 172.21.15.190:0/1789563947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f923406f3b0 0x7f923412e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92327fc700 1 --2- 172.21.15.190:0/1789563947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92340b0640 0x7f92340aba90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f922400c7c0 tx=0x7f9224007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f921affd700 1 -- 172.21.15.190:0/1789563947 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224005a70 con 0x7f92340b0640 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f921affd700 1 -- 172.21.15.190:0/1789563947 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9224005bd0 con 0x7f92340b0640 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92398db700 1 -- 172.21.15.190:0/1789563947 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92280094f0 con 0x7f92340b0640 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f921affd700 1 -- 172.21.15.190:0/1789563947 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92240070d0 con 0x7f92340b0640 2023-09-28T00:15:04.770 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f92398db700 1 -- 172.21.15.190:0/1789563947 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f923412f360 con 0x7f92340b0640 2023-09-28T00:15:04.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f921affd700 1 -- 172.21.15.190:0/1789563947 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f922401c440 con 0x7f92340b0640 2023-09-28T00:15:04.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.765+0000 7f921affd700 1 -- 172.21.15.190:0/1789563947 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9224012750 con 0x7f92340b0640 2023-09-28T00:15:04.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.766+0000 7f92398db700 1 -- 172.21.15.190:0/1789563947 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f923404c3c0 con 0x7f92340b0640 2023-09-28T00:15:04.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.768+0000 7f921affd700 1 -- 172.21.15.190:0/1789563947 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f9224017070 con 0x7f92340b0640 2023-09-28T00:15:04.852 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.851+0000 7f92398db700 1 -- 172.21.15.190:0/1789563947 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8", "id": 0} v 0) v1 -- 0x7f923412faf0 con 0x7f92340b0640 2023-09-28T00:15:04.855 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.854+0000 7f921affd700 1 -- 172.21.15.190:0/1789563947 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f92240076c0 con 0x7f92340b0640 2023-09-28T00:15:04.855 INFO:teuthology.orchestra.run.smithi190.stdout:0 2023-09-28T00:15:04.856 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.855+0000 7f92398db700 1 -- 172.21.15.190:0/1789563947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92340b0640 msgr2=0x7f92340aba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.856 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.855+0000 7f92398db700 1 --2- 172.21.15.190:0/1789563947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92340b0640 0x7f92340aba90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f922400c7c0 tx=0x7f9224007f70 comp rx=0 tx=0).stop 2023-09-28T00:15:04.856 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.855+0000 7f92398db700 1 -- 172.21.15.190:0/1789563947 shutdown_connections 2023-09-28T00:15:04.856 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.855+0000 7f92398db700 1 --2- 172.21.15.190:0/1789563947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9234142ec0 0x7f9234133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.857 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.855+0000 7f92398db700 1 --2- 172.21.15.190:0/1789563947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f923406f3b0 0x7f923412e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.857 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.855+0000 7f92398db700 1 --2- 172.21.15.190:0/1789563947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f92340b0640 0x7f92340aba90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.857 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.855+0000 7f92398db700 1 -- 172.21.15.190:0/1789563947 >> 172.21.15.190:0/1789563947 conn(0x7f92340ca740 msgr2=0x7f9234141f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:04.857 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.855+0000 7f92398db700 1 -- 172.21.15.190:0/1789563947 shutdown_connections 2023-09-28T00:15:04.857 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.855+0000 7f92398db700 1 -- 172.21.15.190:0/1789563947 wait complete. 2023-09-28T00:15:04.867 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new ed631803-d97e-4de7-9e2e-789319144458 1 2023-09-28T00:15:04.982 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.981+0000 7fdcca3cf700 1 Processor -- start 2023-09-28T00:15:04.983 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.981+0000 7fdcca3cf700 1 -- start start 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcca3cf700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdcc4159500 0x7fdcc41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcca3cf700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc415dab0 0x7fdcc40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcca3cf700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40b1110 con 0x7fdcc40b3fd0 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcca3cf700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc40b13b0 con 0x7fdcc4159500 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcca3cf700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc40b1690 con 0x7fdcc415dab0 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcc3fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdcc4159500 0x7fdcc41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcc896c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc415dab0 0x7fdcc40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcc37fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fdcc40b3fd0 0x7fdcc415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:56650/0 (socket says 172.21.15.190:56650) 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcc3fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdcc4159500 0x7fdcc41598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:58994/0 (socket says 172.21.15.190:58994) 2023-09-28T00:15:04.985 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcc896c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc415dab0 0x7fdcc40cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50326/0 (socket says 172.21.15.190:50326) 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.982+0000 7fdcc37fe700 1 -- 172.21.15.190:0/41336588 learned_addr learned my addr 172.21.15.190:0/41336588 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.983+0000 7fdcc3fff700 1 -- 172.21.15.190:0/41336588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc415dab0 msgr2=0x7fdcc40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.983+0000 7fdcc3fff700 1 --2- 172.21.15.190:0/41336588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc415dab0 0x7fdcc40cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.983+0000 7fdcc3fff700 1 -- 172.21.15.190:0/41336588 >> v1:172.21.15.190:6789/0 conn(0x7fdcc40b3fd0 legacy=0x7fdcc415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.983+0000 7fdcc3fff700 1 -- 172.21.15.190:0/41336588 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40b1970 con 0x7fdcc4159500 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.983+0000 7fdcc896c700 1 --2- 172.21.15.190:0/41336588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc415dab0 0x7fdcc40cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.983+0000 7fdcc3fff700 1 --2- 172.21.15.190:0/41336588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc4159500 0x7fdcc41598d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80098e0 tx=0x7fdcb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f35de4d966be44 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.983+0000 7fdcc2ffd700 1 -- 172.21.15.190:0/41336588 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800b640 con 0x7fdcc4159500 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.983+0000 7fdcc2ffd700 1 -- 172.21.15.190:0/41336588 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb800b7a0 con 0x7fdcc4159500 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.983+0000 7fdcc2ffd700 1 -- 172.21.15.190:0/41336588 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb800bb40 con 0x7fdcc4159500 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.984+0000 7fdcca3cf700 1 -- 172.21.15.190:0/41336588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc4159500 msgr2=0x7fdcc41598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.986 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.984+0000 7fdcca3cf700 1 --2- 172.21.15.190:0/41336588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc4159500 0x7fdcc41598d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdcb80098e0 tx=0x7fdcb80091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.987 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.984+0000 7fdcca3cf700 1 -- 172.21.15.190:0/41336588 shutdown_connections 2023-09-28T00:15:04.987 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.984+0000 7fdcca3cf700 1 --2- 172.21.15.190:0/41336588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc415dab0 0x7fdcc40cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.987 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.984+0000 7fdcca3cf700 1 --2- 172.21.15.190:0/41336588 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc4159500 0x7fdcc41598d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.987 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.984+0000 7fdcca3cf700 1 -- 172.21.15.190:0/41336588 >> 172.21.15.190:0/41336588 conn(0x7fdcc4067630 msgr2=0x7fdcc4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:04.987 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.984+0000 7fdcca3cf700 1 -- 172.21.15.190:0/41336588 shutdown_connections 2023-09-28T00:15:04.987 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.984+0000 7fdcca3cf700 1 -- 172.21.15.190:0/41336588 wait complete. 2023-09-28T00:15:04.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.985+0000 7fdcca3cf700 1 Processor -- start 2023-09-28T00:15:04.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.985+0000 7fdcca3cf700 1 -- start start 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcca3cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcc40b3fd0 0x7fdcc414a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcca3cf700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc4159500 0x7fdcc414c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcca3cf700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc415dab0 0x7fdcc415a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcca3cf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc414d820 con 0x7fdcc40b3fd0 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcca3cf700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc415ccf0 con 0x7fdcc415dab0 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcca3cf700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc414d260 con 0x7fdcc4159500 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc37fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc4159500 0x7fdcc414c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc896c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc415dab0 0x7fdcc415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc37fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc4159500 0x7fdcc414c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50328/0 (socket says 172.21.15.190:50328) 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc37fe700 1 -- 172.21.15.190:0/297594038 learned_addr learned my addr 172.21.15.190:0/297594038 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:04.990 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc896c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc415dab0 0x7fdcc415a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:59010/0 (socket says 172.21.15.190:59010) 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc3fff700 1 --2- 172.21.15.190:0/297594038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcc40b3fd0 0x7fdcc414a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc37fe700 1 -- 172.21.15.190:0/297594038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc415dab0 msgr2=0x7fdcc415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc37fe700 1 --2- 172.21.15.190:0/297594038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc415dab0 0x7fdcc415a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc37fe700 1 -- 172.21.15.190:0/297594038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcc40b3fd0 msgr2=0x7fdcc414a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc37fe700 1 --2- 172.21.15.190:0/297594038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcc40b3fd0 0x7fdcc414a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc37fe700 1 -- 172.21.15.190:0/297594038 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc009a20 con 0x7fdcc4159500 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc896c700 1 --2- 172.21.15.190:0/297594038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc415dab0 0x7fdcc415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcc37fe700 1 --2- 172.21.15.190:0/297594038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc4159500 0x7fdcc414c7a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c590 tx=0x7fdcb4001020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcabfff700 1 -- 172.21.15.190:0/297594038 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4005b30 con 0x7fdcc4159500 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcabfff700 1 -- 172.21.15.190:0/297594038 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb4005cb0 con 0x7fdcc4159500 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.986+0000 7fdcca3cf700 1 -- 172.21.15.190:0/297594038 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb8009420 con 0x7fdcc4159500 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.987+0000 7fdcabfff700 1 -- 172.21.15.190:0/297594038 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4007320 con 0x7fdcc4159500 2023-09-28T00:15:04.991 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.987+0000 7fdcca3cf700 1 -- 172.21.15.190:0/297594038 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc4159a70 con 0x7fdcc4159500 2023-09-28T00:15:04.992 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.987+0000 7fdcabfff700 1 -- 172.21.15.190:0/297594038 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdcb401c6c0 con 0x7fdcc4159500 2023-09-28T00:15:04.992 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.987+0000 7fdcabfff700 1 -- 172.21.15.190:0/297594038 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fdcb40127c0 con 0x7fdcc4159500 2023-09-28T00:15:04.992 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.987+0000 7fdcca3cf700 1 -- 172.21.15.190:0/297594038 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc41598d0 con 0x7fdcc4159500 2023-09-28T00:15:04.992 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:04.990+0000 7fdcabfff700 1 -- 172.21.15.190:0/297594038 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fdcc41598d0 con 0x7fdcc4159500 2023-09-28T00:15:05.073 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.073+0000 7fdcca3cf700 1 -- 172.21.15.190:0/297594038 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ed631803-d97e-4de7-9e2e-789319144458", "id": 1} v 0) v1 -- 0x7fdcc4064050 con 0x7fdcc4159500 2023-09-28T00:15:05.076 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.075+0000 7fdcabfff700 1 -- 172.21.15.190:0/297594038 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ed631803-d97e-4de7-9e2e-789319144458", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdcb4017070 con 0x7fdcc4159500 2023-09-28T00:15:05.076 INFO:teuthology.orchestra.run.smithi190.stdout:1 2023-09-28T00:15:05.078 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.076+0000 7fdcca3cf700 1 -- 172.21.15.190:0/297594038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc4159500 msgr2=0x7fdcc414c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.078 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.076+0000 7fdcca3cf700 1 --2- 172.21.15.190:0/297594038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc4159500 0x7fdcc414c7a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdcb400c590 tx=0x7fdcb4001020 comp rx=0 tx=0).stop 2023-09-28T00:15:05.078 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.076+0000 7fdcca3cf700 1 -- 172.21.15.190:0/297594038 shutdown_connections 2023-09-28T00:15:05.078 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.076+0000 7fdcca3cf700 1 --2- 172.21.15.190:0/297594038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcc415dab0 0x7fdcc415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.078 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.076+0000 7fdcca3cf700 1 --2- 172.21.15.190:0/297594038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcc40b3fd0 0x7fdcc414a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.078 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.076+0000 7fdcca3cf700 1 --2- 172.21.15.190:0/297594038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcc4159500 0x7fdcc414c7a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.078 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.076+0000 7fdcca3cf700 1 -- 172.21.15.190:0/297594038 >> 172.21.15.190:0/297594038 conn(0x7fdcc4067630 msgr2=0x7fdcc414b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:05.078 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.077+0000 7fdcca3cf700 1 -- 172.21.15.190:0/297594038 shutdown_connections 2023-09-28T00:15:05.078 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.077+0000 7fdcca3cf700 1 -- 172.21.15.190:0/297594038 wait complete. 2023-09-28T00:15:05.089 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new c20af5a6-8a13-4cf2-b6ca-de79e551bb42 2 2023-09-28T00:15:05.204 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.203+0000 7f7faaff4700 1 Processor -- start 2023-09-28T00:15:05.204 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.203+0000 7f7faaff4700 1 -- start start 2023-09-28T00:15:05.207 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.203+0000 7f7faaff4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7fa415cb10 0x7f7fa40af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.207 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.203+0000 7f7faaff4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b4000 0x7f7fa4159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.207 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.203+0000 7f7faaff4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7fa40b1690 0x7f7fa40b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.207 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.203+0000 7f7faaff4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa40698e0 con 0x7f7fa40b1690 2023-09-28T00:15:05.207 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.203+0000 7f7faaff4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa40b2020 con 0x7f7fa415cb10 2023-09-28T00:15:05.207 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.203+0000 7f7faaff4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4068fd0 con 0x7f7fa40b4000 2023-09-28T00:15:05.208 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa8d90700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7fa415cb10 0x7f7fa40af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.208 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa3fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b4000 0x7f7fa4159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.208 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa3fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b4000 0x7f7fa4159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50342/0 (socket says 172.21.15.190:50342) 2023-09-28T00:15:05.208 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa8d90700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7fa415cb10 0x7f7fa40af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:59018/0 (socket says 172.21.15.190:59018) 2023-09-28T00:15:05.208 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa3fff700 1 -- 172.21.15.190:0/2016132839 learned_addr learned my addr 172.21.15.190:0/2016132839 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:05.208 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa9591700 1 --2- 172.21.15.190:0/2016132839 >> v2:172.21.15.26:3300/0 conn(0x7f7fa40b1690 0x7f7fa40b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.208 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa3fff700 1 -- 172.21.15.190:0/2016132839 >> v2:172.21.15.190:3300/0 conn(0x7f7fa415cb10 msgr2=0x7f7fa40af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:05.208 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa3fff700 1 --2- 172.21.15.190:0/2016132839 >> v2:172.21.15.190:3300/0 conn(0x7f7fa415cb10 0x7f7fa40af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.209 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa3fff700 1 -- 172.21.15.190:0/2016132839 >> v2:172.21.15.26:3300/0 conn(0x7f7fa40b1690 msgr2=0x7f7fa40b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:05.209 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa3fff700 1 --2- 172.21.15.190:0/2016132839 >> v2:172.21.15.26:3300/0 conn(0x7f7fa40b1690 0x7f7fa40b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.209 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa3fff700 1 -- 172.21.15.190:0/2016132839 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40b0020 con 0x7f7fa40b4000 2023-09-28T00:15:05.209 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa8d90700 1 --2- 172.21.15.190:0/2016132839 >> v2:172.21.15.190:3300/0 conn(0x7f7fa415cb10 0x7f7fa40af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:05.209 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa3fff700 1 --2- 172.21.15.190:0/2016132839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b4000 0x7f7fa4159b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7fa406ac80 tx=0x7f7f90009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81df68e85d455bd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:05.209 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa37fe700 1 -- 172.21.15.190:0/2016132839 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000b640 con 0x7f7fa40b4000 2023-09-28T00:15:05.209 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa37fe700 1 -- 172.21.15.190:0/2016132839 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9000b7a0 con 0x7f7fa40b4000 2023-09-28T00:15:05.209 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.204+0000 7f7fa37fe700 1 -- 172.21.15.190:0/2016132839 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000bb60 con 0x7f7fa40b4000 2023-09-28T00:15:05.209 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.205+0000 7f7faaff4700 1 -- 172.21.15.190:0/2016132839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b4000 msgr2=0x7f7fa4159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.210 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.205+0000 7f7faaff4700 1 --2- 172.21.15.190:0/2016132839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b4000 0x7f7fa4159b50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7fa406ac80 tx=0x7f7f90009250 comp rx=0 tx=0).stop 2023-09-28T00:15:05.210 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.205+0000 7f7faaff4700 1 -- 172.21.15.190:0/2016132839 shutdown_connections 2023-09-28T00:15:05.210 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.205+0000 7f7faaff4700 1 --2- 172.21.15.190:0/2016132839 >> v2:172.21.15.26:3300/0 conn(0x7f7fa40b1690 0x7f7fa40b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.210 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.205+0000 7f7faaff4700 1 --2- 172.21.15.190:0/2016132839 >> v2:172.21.15.190:3300/0 conn(0x7f7fa415cb10 0x7f7fa40af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.210 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.205+0000 7f7faaff4700 1 --2- 172.21.15.190:0/2016132839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b4000 0x7f7fa4159b50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.210 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.205+0000 7f7faaff4700 1 -- 172.21.15.190:0/2016132839 >> 172.21.15.190:0/2016132839 conn(0x7f7fa406d890 msgr2=0x7f7fa406dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:05.210 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.205+0000 7f7faaff4700 1 -- 172.21.15.190:0/2016132839 shutdown_connections 2023-09-28T00:15:05.211 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.205+0000 7f7faaff4700 1 -- 172.21.15.190:0/2016132839 wait complete. 2023-09-28T00:15:05.211 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.206+0000 7f7faaff4700 1 Processor -- start 2023-09-28T00:15:05.211 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.206+0000 7f7faaff4700 1 -- start start 2023-09-28T00:15:05.213 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7faaff4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b1690 0x7f7fa4144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.213 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7faaff4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa40b4000 0x7f7fa40cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.214 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7faaff4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa415cb10 0x7f7fa40cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.214 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7faaff4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40c8f30 con 0x7f7fa415cb10 2023-09-28T00:15:05.214 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7faaff4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa4144ff0 con 0x7f7fa40b4000 2023-09-28T00:15:05.214 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7faaff4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40c8690 con 0x7f7fa40b1690 2023-09-28T00:15:05.214 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa8d90700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b1690 0x7f7fa4144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.214 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa8d90700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b1690 0x7f7fa4144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50350/0 (socket says 172.21.15.190:50350) 2023-09-28T00:15:05.214 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa3fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa40b4000 0x7f7fa40cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.214 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa8d90700 1 -- 172.21.15.190:0/4009244861 learned_addr learned my addr 172.21.15.190:0/4009244861 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:05.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa9591700 1 --2- 172.21.15.190:0/4009244861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa415cb10 0x7f7fa40cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa3fff700 1 -- 172.21.15.190:0/4009244861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b1690 msgr2=0x7f7fa4144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa3fff700 1 --2- 172.21.15.190:0/4009244861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b1690 0x7f7fa4144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa3fff700 1 -- 172.21.15.190:0/4009244861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa415cb10 msgr2=0x7f7fa40cd1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa3fff700 1 --2- 172.21.15.190:0/4009244861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa415cb10 0x7f7fa40cd1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa3fff700 1 -- 172.21.15.190:0/4009244861 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98009420 con 0x7f7fa40b4000 2023-09-28T00:15:05.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.207+0000 7f7fa3fff700 1 --2- 172.21.15.190:0/4009244861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa40b4000 0x7f7fa40cccb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b1420 tx=0x7f7f90017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:05.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.208+0000 7f7fa0ff9700 1 -- 172.21.15.190:0/4009244861 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000b910 con 0x7f7fa40b4000 2023-09-28T00:15:05.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.208+0000 7f7fa0ff9700 1 -- 172.21.15.190:0/4009244861 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9000ba70 con 0x7f7fa40b4000 2023-09-28T00:15:05.216 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.208+0000 7f7faaff4700 1 -- 172.21.15.190:0/4009244861 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f900094f0 con 0x7f7fa40b4000 2023-09-28T00:15:05.216 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.208+0000 7f7fa0ff9700 1 -- 172.21.15.190:0/4009244861 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90011650 con 0x7f7fa40b4000 2023-09-28T00:15:05.216 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.208+0000 7f7faaff4700 1 -- 172.21.15.190:0/4009244861 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa40c8c50 con 0x7f7fa40b4000 2023-09-28T00:15:05.216 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.208+0000 7f7fa0ff9700 1 -- 172.21.15.190:0/4009244861 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7f90011c80 con 0x7f7fa40b4000 2023-09-28T00:15:05.216 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.208+0000 7f7fa0ff9700 1 -- 172.21.15.190:0/4009244861 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f7f90025820 con 0x7f7fa40b4000 2023-09-28T00:15:05.216 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.209+0000 7f7faaff4700 1 -- 172.21.15.190:0/4009244861 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa4064050 con 0x7f7fa40b4000 2023-09-28T00:15:05.216 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.211+0000 7f7fa0ff9700 1 -- 172.21.15.190:0/4009244861 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f7f90015020 con 0x7f7fa40b4000 2023-09-28T00:15:05.286 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:05.287+0000 7f0f1e164180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-28T00:15:05.287 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:05.287+0000 7f35576ed180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-28T00:15:05.303 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.302+0000 7f7faaff4700 1 -- 172.21.15.190:0/4009244861 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c20af5a6-8a13-4cf2-b6ca-de79e551bb42", "id": 2} v 0) v1 -- 0x7f7fa4069290 con 0x7f7fa40b4000 2023-09-28T00:15:05.306 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.306+0000 7f7fa0ff9700 1 -- 172.21.15.190:0/4009244861 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c20af5a6-8a13-4cf2-b6ca-de79e551bb42", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7f900253f0 con 0x7f7fa40b4000 2023-09-28T00:15:05.306 INFO:teuthology.orchestra.run.smithi190.stdout:2 2023-09-28T00:15:05.307 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.306+0000 7f7faaff4700 1 -- 172.21.15.190:0/4009244861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa40b4000 msgr2=0x7f7fa40cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.308 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.306+0000 7f7faaff4700 1 --2- 172.21.15.190:0/4009244861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa40b4000 0x7f7fa40cccb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40b1420 tx=0x7f7f90017000 comp rx=0 tx=0).stop 2023-09-28T00:15:05.308 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.306+0000 7f7faaff4700 1 -- 172.21.15.190:0/4009244861 shutdown_connections 2023-09-28T00:15:05.308 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.306+0000 7f7faaff4700 1 --2- 172.21.15.190:0/4009244861 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7fa40b1690 0x7f7fa4144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.308 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.306+0000 7f7faaff4700 1 --2- 172.21.15.190:0/4009244861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa415cb10 0x7f7fa40cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.308 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.306+0000 7f7faaff4700 1 --2- 172.21.15.190:0/4009244861 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7fa40b4000 0x7f7fa40cccb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.308 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.306+0000 7f7faaff4700 1 -- 172.21.15.190:0/4009244861 >> 172.21.15.190:0/4009244861 conn(0x7f7fa406d890 msgr2=0x7f7fa415c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:05.308 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.307+0000 7f7faaff4700 1 -- 172.21.15.190:0/4009244861 shutdown_connections 2023-09-28T00:15:05.308 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.307+0000 7f7faaff4700 1 -- 172.21.15.190:0/4009244861 wait complete. 2023-09-28T00:15:05.319 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 981d7b91-506e-4842-a2b4-a1ca4ec0376d 3 2023-09-28T00:15:05.425 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:05.425+0000 7f0f1e164180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-28T00:15:05.426 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:05.426+0000 7f35576ed180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-28T00:15:05.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.434+0000 7f75a7fff700 1 Processor -- start 2023-09-28T00:15:05.435 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.434+0000 7f75a7fff700 1 -- start start 2023-09-28T00:15:05.437 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.435+0000 7f75a7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75a8142e90 0x7f75a8069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.435+0000 7f75a7fff700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a8069380 con 0x7f75a8069d50 2023-09-28T00:15:05.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.435+0000 7f75a7fff700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a80b63a0 con 0x7f75a815d9a0 2023-09-28T00:15:05.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.435+0000 7f75a7fff700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a8068770 con 0x7f75a8142e90 2023-09-28T00:15:05.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.435+0000 7f75a77fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f75a815d9a0 0x7f75a80b5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:56652/0 (socket says 172.21.15.190:56652) 2023-09-28T00:15:05.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.435+0000 7f75a77fe700 1 -- 172.21.15.190:0/3682156259 learned_addr learned my addr 172.21.15.190:0/3682156259 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-09-28T00:15:05.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.435+0000 7f75a6ffd700 1 --2- 172.21.15.190:0/3682156259 >> v2:172.21.15.26:3300/0 conn(0x7f75a8142e90 0x7f75a8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.435+0000 7f75a5ffb700 1 -- 172.21.15.190:0/3682156259 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868072134 0 0) 0x7f75a80b63a0 con 0x7f75a815d9a0 2023-09-28T00:15:05.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.435+0000 7f75a5ffb700 1 -- 172.21.15.190:0/3682156259 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7594003570 con 0x7f75a815d9a0 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.436+0000 7f75a6ffd700 1 -- 172.21.15.190:0/3682156259 >> v1:172.21.15.190:6789/0 conn(0x7f75a815d9a0 legacy=0x7f75a80b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.436+0000 7f75a6ffd700 1 -- 172.21.15.190:0/3682156259 >> v1:172.21.15.26:6789/0 conn(0x7f75a8069d50 legacy=0x7f75a815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.436+0000 7f75a5ffb700 1 -- 172.21.15.190:0/3682156259 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127729875 0 0) 0x7f75a8069380 con 0x7f75a8069d50 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.436+0000 7f75a6ffd700 1 -- 172.21.15.190:0/3682156259 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8068a50 con 0x7f75a8142e90 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.436+0000 7f75a6ffd700 1 --2- 172.21.15.190:0/3682156259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a8142e90 0x7f75a8069810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f75980098e0 tx=0x7f75980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c211f8d1cb88789d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.436+0000 7f75a5ffb700 1 -- 172.21.15.190:0/3682156259 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800b640 con 0x7f75a8142e90 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.436+0000 7f75a5ffb700 1 -- 172.21.15.190:0/3682156259 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759800b7a0 con 0x7f75a8142e90 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.436+0000 7f75a5ffb700 1 -- 172.21.15.190:0/3682156259 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759800bb40 con 0x7f75a8142e90 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.437+0000 7f75a7fff700 1 -- 172.21.15.190:0/3682156259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a8142e90 msgr2=0x7f75a8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.437+0000 7f75a7fff700 1 --2- 172.21.15.190:0/3682156259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a8142e90 0x7f75a8069810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f75980098e0 tx=0x7f75980091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.437+0000 7f75a7fff700 1 -- 172.21.15.190:0/3682156259 shutdown_connections 2023-09-28T00:15:05.439 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.437+0000 7f75a7fff700 1 --2- 172.21.15.190:0/3682156259 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a8142e90 0x7f75a8069810 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.440 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.437+0000 7f75a7fff700 1 -- 172.21.15.190:0/3682156259 >> 172.21.15.190:0/3682156259 conn(0x7f75a80ccfe0 msgr2=0x7f75a80cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:05.440 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.437+0000 7f75a7fff700 1 -- 172.21.15.190:0/3682156259 shutdown_connections 2023-09-28T00:15:05.440 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.437+0000 7f75a7fff700 1 -- 172.21.15.190:0/3682156259 wait complete. 2023-09-28T00:15:05.442 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.438+0000 7f75a7fff700 1 Processor -- start 2023-09-28T00:15:05.442 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.438+0000 7f75a7fff700 1 -- start start 2023-09-28T00:15:05.442 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a8069d50 0x7f75a80c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.442 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a8142e90 0x7f75a815bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a815d9a0 0x7f75a815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a7fff700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a815c730 con 0x7f75a8069d50 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a7fff700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a815b820 con 0x7f75a8142e90 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a7fff700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a815aef0 con 0x7f75a815d9a0 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a77fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a815d9a0 0x7f75a815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a67fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a8142e90 0x7f75a815bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a77fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a815d9a0 0x7f75a815c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50358/0 (socket says 172.21.15.190:50358) 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a77fe700 1 -- 172.21.15.190:0/402303693 learned_addr learned my addr 172.21.15.190:0/402303693 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a6ffd700 1 --2- 172.21.15.190:0/402303693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a8069d50 0x7f75a80c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a67fc700 1 -- 172.21.15.190:0/402303693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a815d9a0 msgr2=0x7f75a815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a67fc700 1 --2- 172.21.15.190:0/402303693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a815d9a0 0x7f75a815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.443 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a67fc700 1 -- 172.21.15.190:0/402303693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a8069d50 msgr2=0x7f75a80c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a67fc700 1 --2- 172.21.15.190:0/402303693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a8069d50 0x7f75a80c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a67fc700 1 -- 172.21.15.190:0/402303693 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7598009420 con 0x7f75a8142e90 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a77fe700 1 --2- 172.21.15.190:0/402303693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a815d9a0 0x7f75a815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a67fc700 1 --2- 172.21.15.190:0/402303693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a8142e90 0x7f75a815bcb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f75900011e0 tx=0x7f7590007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f759effd700 1 -- 172.21.15.190:0/402303693 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590011590 con 0x7f75a8142e90 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f759effd700 1 -- 172.21.15.190:0/402303693 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7590011710 con 0x7f75a8142e90 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a7fff700 1 -- 172.21.15.190:0/402303693 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a815b1d0 con 0x7f75a8142e90 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f759effd700 1 -- 172.21.15.190:0/402303693 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7590011ad0 con 0x7f75a8142e90 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.439+0000 7f75a7fff700 1 -- 172.21.15.190:0/402303693 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a80cc440 con 0x7f75a8142e90 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.440+0000 7f759effd700 1 -- 172.21.15.190:0/402303693 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f759001c6c0 con 0x7f75a8142e90 2023-09-28T00:15:05.444 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.440+0000 7f759effd700 1 -- 172.21.15.190:0/402303693 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f75900128c0 con 0x7f75a8142e90 2023-09-28T00:15:05.445 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.440+0000 7f75a7fff700 1 -- 172.21.15.190:0/402303693 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a815b990 con 0x7f75a8142e90 2023-09-28T00:15:05.445 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.442+0000 7f759effd700 1 -- 172.21.15.190:0/402303693 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f7590017070 con 0x7f75a8142e90 2023-09-28T00:15:05.504 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:05.504+0000 7f0f1e164180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-28T00:15:05.505 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:05.504+0000 7f35576ed180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-28T00:15:05.525 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.525+0000 7f75a7fff700 1 -- 172.21.15.190:0/402303693 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "981d7b91-506e-4842-a2b4-a1ca4ec0376d", "id": 3} v 0) v1 -- 0x7f75a804c3c0 con 0x7f75a8142e90 2023-09-28T00:15:05.528 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.528+0000 7f759effd700 1 -- 172.21.15.190:0/402303693 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "981d7b91-506e-4842-a2b4-a1ca4ec0376d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f759001cba0 con 0x7f75a8142e90 2023-09-28T00:15:05.529 INFO:teuthology.orchestra.run.smithi190.stdout:3 2023-09-28T00:15:05.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.529+0000 7f75a7fff700 1 -- 172.21.15.190:0/402303693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a8142e90 msgr2=0x7f75a815bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.529+0000 7f75a7fff700 1 --2- 172.21.15.190:0/402303693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a8142e90 0x7f75a815bcb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f75900011e0 tx=0x7f7590007d30 comp rx=0 tx=0).stop 2023-09-28T00:15:05.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.529+0000 7f75a7fff700 1 -- 172.21.15.190:0/402303693 shutdown_connections 2023-09-28T00:15:05.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.529+0000 7f75a7fff700 1 --2- 172.21.15.190:0/402303693 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75a815d9a0 0x7f75a815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.529+0000 7f75a7fff700 1 --2- 172.21.15.190:0/402303693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75a8069d50 0x7f75a80c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.529+0000 7f75a7fff700 1 --2- 172.21.15.190:0/402303693 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75a8142e90 0x7f75a815bcb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.529+0000 7f75a7fff700 1 -- 172.21.15.190:0/402303693 >> 172.21.15.190:0/402303693 conn(0x7f75a80ccfe0 msgr2=0x7f75a81593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:05.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.529+0000 7f75a7fff700 1 -- 172.21.15.190:0/402303693 shutdown_connections 2023-09-28T00:15:05.530 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.529+0000 7f75a7fff700 1 -- 172.21.15.190:0/402303693 wait complete. 2023-09-28T00:15:05.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 52e8958b-cf61-4e15-9d61-3fbe25e70638 4 2023-09-28T00:15:05.658 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.657+0000 7f9c957ab700 1 Processor -- start 2023-09-28T00:15:05.658 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.657+0000 7f9c957ab700 1 -- start start 2023-09-28T00:15:05.660 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c957ab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c901570c0 0x7f9c900b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c957ab700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c9015da60 0x7f9c901426c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c957ab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c900b5b20 con 0x7f9c90157490 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c957ab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c900b5920 con 0x7f9c901570c0 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c957ab700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900b5dc0 con 0x7f9c9015da60 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c8f7fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c9015da60 0x7f9c901426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c8f7fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c9015da60 0x7f9c901426c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50370/0 (socket says 172.21.15.190:50370) 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c8f7fe700 1 -- 172.21.15.190:0/202085821 learned_addr learned my addr 172.21.15.190:0/202085821 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c8effd700 1 --2- 172.21.15.190:0/202085821 >> v2:172.21.15.26:3300/0 conn(0x7f9c901570c0 0x7f9c900b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c8f7fe700 1 -- 172.21.15.190:0/202085821 >> v2:172.21.15.26:3300/0 conn(0x7f9c901570c0 msgr2=0x7f9c900b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:05.661 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c8f7fe700 1 --2- 172.21.15.190:0/202085821 >> v2:172.21.15.26:3300/0 conn(0x7f9c901570c0 0x7f9c900b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c8f7fe700 1 -- 172.21.15.190:0/202085821 >> v1:172.21.15.26:6789/0 conn(0x7f9c90157490 legacy=0x7f9c9015d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c8f7fe700 1 -- 172.21.15.190:0/202085821 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c900b60a0 con 0x7f9c9015da60 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.658+0000 7f9c8effd700 1 --2- 172.21.15.190:0/202085821 >> v2:172.21.15.26:3300/0 conn(0x7f9c901570c0 0x7f9c900b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c8f7fe700 1 --2- 172.21.15.190:0/202085821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c9015da60 0x7f9c901426c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009f20 tx=0x7f9c88009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19dc22011f44739 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c8dffb700 1 -- 172.21.15.190:0/202085821 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800e070 con 0x7f9c9015da60 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c8dffb700 1 -- 172.21.15.190:0/202085821 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8800ba80 con 0x7f9c9015da60 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c8dffb700 1 -- 172.21.15.190:0/202085821 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c880092e0 con 0x7f9c9015da60 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c957ab700 1 -- 172.21.15.190:0/202085821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c9015da60 msgr2=0x7f9c901426c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c957ab700 1 --2- 172.21.15.190:0/202085821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c9015da60 0x7f9c901426c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c88009f20 tx=0x7f9c88009840 comp rx=0 tx=0).stop 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c957ab700 1 -- 172.21.15.190:0/202085821 shutdown_connections 2023-09-28T00:15:05.662 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c957ab700 1 --2- 172.21.15.190:0/202085821 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c9015da60 0x7f9c901426c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c957ab700 1 --2- 172.21.15.190:0/202085821 >> v2:172.21.15.26:3300/0 conn(0x7f9c901570c0 0x7f9c900b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c957ab700 1 -- 172.21.15.190:0/202085821 >> 172.21.15.190:0/202085821 conn(0x7f9c900ccfc0 msgr2=0x7f9c900cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:05.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c957ab700 1 -- 172.21.15.190:0/202085821 shutdown_connections 2023-09-28T00:15:05.663 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.659+0000 7f9c957ab700 1 -- 172.21.15.190:0/202085821 wait complete. 2023-09-28T00:15:05.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.660+0000 7f9c957ab700 1 Processor -- start 2023-09-28T00:15:05.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.660+0000 7f9c957ab700 1 -- start start 2023-09-28T00:15:05.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c957ab700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c901570c0 0x7f9c90153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c957ab700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c90157490 0x7f9c9014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c957ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9015da60 0x7f9c90151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c957ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90153850 con 0x7f9c9015da60 2023-09-28T00:15:05.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c957ab700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90152270 con 0x7f9c90157490 2023-09-28T00:15:05.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c957ab700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90152550 con 0x7f9c901570c0 2023-09-28T00:15:05.665 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c8effd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c901570c0 0x7f9c90153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c8e7fc700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c90157490 0x7f9c9014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c8effd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c901570c0 0x7f9c90153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50372/0 (socket says 172.21.15.190:50372) 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c8effd700 1 -- 172.21.15.190:0/2334969529 learned_addr learned my addr 172.21.15.190:0/2334969529 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.661+0000 7f9c8f7fe700 1 --2- 172.21.15.190:0/2334969529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9015da60 0x7f9c90151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c8effd700 1 -- 172.21.15.190:0/2334969529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c90157490 msgr2=0x7f9c9014ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c8effd700 1 --2- 172.21.15.190:0/2334969529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c90157490 0x7f9c9014ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c8effd700 1 -- 172.21.15.190:0/2334969529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9015da60 msgr2=0x7f9c90151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c8effd700 1 --2- 172.21.15.190:0/2334969529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9015da60 0x7f9c90151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c8effd700 1 -- 172.21.15.190:0/2334969529 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88009ae0 con 0x7f9c901570c0 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c8effd700 1 --2- 172.21.15.190:0/2334969529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c901570c0 0x7f9c90153310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400e8d0 tx=0x7f9c84008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:05.666 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c76ffd700 1 -- 172.21.15.190:0/2334969529 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84013410 con 0x7f9c901570c0 2023-09-28T00:15:05.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c76ffd700 1 -- 172.21.15.190:0/2334969529 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84013570 con 0x7f9c901570c0 2023-09-28T00:15:05.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c957ab700 1 -- 172.21.15.190:0/2334969529 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c90152830 con 0x7f9c901570c0 2023-09-28T00:15:05.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c76ffd700 1 -- 172.21.15.190:0/2334969529 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840138f0 con 0x7f9c901570c0 2023-09-28T00:15:05.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c957ab700 1 -- 172.21.15.190:0/2334969529 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c90152df0 con 0x7f9c901570c0 2023-09-28T00:15:05.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c76ffd700 1 -- 172.21.15.190:0/2334969529 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9c84013d20 con 0x7f9c901570c0 2023-09-28T00:15:05.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.662+0000 7f9c76ffd700 1 -- 172.21.15.190:0/2334969529 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f9c84012370 con 0x7f9c901570c0 2023-09-28T00:15:05.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.663+0000 7f9c957ab700 1 -- 172.21.15.190:0/2334969529 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9004c3c0 con 0x7f9c901570c0 2023-09-28T00:15:05.667 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.665+0000 7f9c76ffd700 1 -- 172.21.15.190:0/2334969529 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f9c84020060 con 0x7f9c901570c0 2023-09-28T00:15:05.697 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:05.697+0000 7f0f1e164180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-28T00:15:05.714 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:05.713+0000 7f35576ed180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-28T00:15:05.766 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.766+0000 7f9c957ab700 1 -- 172.21.15.190:0/2334969529 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "52e8958b-cf61-4e15-9d61-3fbe25e70638", "id": 4} v 0) v1 -- 0x7f9c900b6380 con 0x7f9c901570c0 2023-09-28T00:15:05.769 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.769+0000 7f9c76ffd700 1 -- 172.21.15.190:0/2334969529 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52e8958b-cf61-4e15-9d61-3fbe25e70638", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c8400f040 con 0x7f9c901570c0 2023-09-28T00:15:05.770 INFO:teuthology.orchestra.run.smithi190.stdout:4 2023-09-28T00:15:05.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.770+0000 7f9c957ab700 1 -- 172.21.15.190:0/2334969529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c901570c0 msgr2=0x7f9c90153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.770+0000 7f9c957ab700 1 --2- 172.21.15.190:0/2334969529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c901570c0 0x7f9c90153310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400e8d0 tx=0x7f9c84008040 comp rx=0 tx=0).stop 2023-09-28T00:15:05.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.770+0000 7f9c957ab700 1 -- 172.21.15.190:0/2334969529 shutdown_connections 2023-09-28T00:15:05.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.770+0000 7f9c957ab700 1 --2- 172.21.15.190:0/2334969529 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c901570c0 0x7f9c90153310 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.770+0000 7f9c957ab700 1 --2- 172.21.15.190:0/2334969529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c9015da60 0x7f9c90151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.771 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.770+0000 7f9c957ab700 1 --2- 172.21.15.190:0/2334969529 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c90157490 0x7f9c9014ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.772 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.770+0000 7f9c957ab700 1 -- 172.21.15.190:0/2334969529 >> 172.21.15.190:0/2334969529 conn(0x7f9c900ccfc0 msgr2=0x7f9c900cf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:05.772 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.770+0000 7f9c957ab700 1 -- 172.21.15.190:0/2334969529 shutdown_connections 2023-09-28T00:15:05.772 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.770+0000 7f9c957ab700 1 -- 172.21.15.190:0/2334969529 wait complete. 2023-09-28T00:15:05.782 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new db77a77e-0529-4dcf-b72a-04f5023122cd 5 2023-09-28T00:15:05.878 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:05.878+0000 7f0f1e164180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-28T00:15:05.893 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:05.893+0000 7f35576ed180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-28T00:15:05.897 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.896+0000 7f027e0d8700 1 Processor -- start 2023-09-28T00:15:05.897 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.897+0000 7f027e0d8700 1 -- start start 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.897+0000 7f027e0d8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02781575b0 0x7f02780ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.897+0000 7f027e0d8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02780cddb0 con 0x7f02781571e0 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.897+0000 7f027e0d8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02780cd1a0 con 0x7f027815b6a0 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.897+0000 7f027e0d8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02780cd480 con 0x7f02781575b0 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.897+0000 7f027c8d5700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f027815b6a0 0x7f02780cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:56666/0 (socket says 172.21.15.190:56666) 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f027c8d5700 1 -- 172.21.15.190:0/1402466710 learned_addr learned my addr 172.21.15.190:0/1402466710 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f027d8d7700 1 --2- 172.21.15.190:0/1402466710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02781575b0 0x7f02780ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f026bfff700 1 -- 172.21.15.190:0/1402466710 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174085019 0 0) 0x7f02780cd1a0 con 0x7f027815b6a0 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f026bfff700 1 -- 172.21.15.190:0/1402466710 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0264003570 con 0x7f027815b6a0 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f027d8d7700 1 -- 172.21.15.190:0/1402466710 >> v1:172.21.15.190:6789/0 conn(0x7f027815b6a0 legacy=0x7f02780cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.900 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f027d8d7700 1 -- 172.21.15.190:0/1402466710 >> v1:172.21.15.26:6789/0 conn(0x7f02781571e0 legacy=0x7f027815af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f027d8d7700 1 -- 172.21.15.190:0/1402466710 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02780cd760 con 0x7f02781575b0 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f027d8d7700 1 --2- 172.21.15.190:0/1402466710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02781575b0 0x7f02780ccb30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0270009e90 tx=0x7f0270009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cefb8468897b736 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f026bfff700 1 -- 172.21.15.190:0/1402466710 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000e070 con 0x7f02781575b0 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f026bfff700 1 -- 172.21.15.190:0/1402466710 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027000bc30 con 0x7f02781575b0 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.898+0000 7f026bfff700 1 -- 172.21.15.190:0/1402466710 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270012430 con 0x7f02781575b0 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.899+0000 7f027e0d8700 1 -- 172.21.15.190:0/1402466710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02781575b0 msgr2=0x7f02780ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.899+0000 7f027e0d8700 1 --2- 172.21.15.190:0/1402466710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02781575b0 0x7f02780ccb30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0270009e90 tx=0x7f0270009780 comp rx=0 tx=0).stop 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.899+0000 7f027e0d8700 1 -- 172.21.15.190:0/1402466710 shutdown_connections 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.899+0000 7f027e0d8700 1 --2- 172.21.15.190:0/1402466710 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02781575b0 0x7f02780ccb30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.899+0000 7f027e0d8700 1 -- 172.21.15.190:0/1402466710 >> 172.21.15.190:0/1402466710 conn(0x7f02780ce390 msgr2=0x7f02780ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.899+0000 7f027e0d8700 1 -- 172.21.15.190:0/1402466710 shutdown_connections 2023-09-28T00:15:05.901 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.899+0000 7f027e0d8700 1 -- 172.21.15.190:0/1402466710 wait complete. 2023-09-28T00:15:05.903 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.900+0000 7f027e0d8700 1 Processor -- start 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.900+0000 7f027e0d8700 1 -- start start 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027e0d8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02781571e0 0x7f0278157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027e0d8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02781575b0 0x7f0278159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027e0d8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f027815b6a0 0x7f0278155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027e0d8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027814aba0 con 0x7f02781575b0 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027e0d8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027814d510 con 0x7f02781571e0 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027e0d8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027814d7f0 con 0x7f027815b6a0 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d8d7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f027815b6a0 0x7f0278155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d0d6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02781571e0 0x7f0278157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d8d7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f027815b6a0 0x7f0278155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50382/0 (socket says 172.21.15.190:50382) 2023-09-28T00:15:05.904 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d8d7700 1 -- 172.21.15.190:0/4269457281 learned_addr learned my addr 172.21.15.190:0/4269457281 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027c8d5700 1 --2- 172.21.15.190:0/4269457281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02781575b0 0x7f0278159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d8d7700 1 -- 172.21.15.190:0/4269457281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02781571e0 msgr2=0x7f0278157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d8d7700 1 --2- 172.21.15.190:0/4269457281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02781571e0 0x7f0278157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d8d7700 1 -- 172.21.15.190:0/4269457281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02781575b0 msgr2=0x7f0278159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d8d7700 1 --2- 172.21.15.190:0/4269457281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02781575b0 0x7f0278159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d8d7700 1 -- 172.21.15.190:0/4269457281 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0270009a20 con 0x7f027815b6a0 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f027d8d7700 1 --2- 172.21.15.190:0/4269457281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f027815b6a0 0x7f0278155410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0270013000 tx=0x7f0270019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.901+0000 7f02697fa700 1 -- 172.21.15.190:0/4269457281 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270027470 con 0x7f027815b6a0 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.902+0000 7f02697fa700 1 -- 172.21.15.190:0/4269457281 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02700275d0 con 0x7f027815b6a0 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.902+0000 7f027e0d8700 1 -- 172.21.15.190:0/4269457281 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027814dad0 con 0x7f027815b6a0 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.902+0000 7f02697fa700 1 -- 172.21.15.190:0/4269457281 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270027990 con 0x7f027815b6a0 2023-09-28T00:15:05.905 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.902+0000 7f027e0d8700 1 -- 172.21.15.190:0/4269457281 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0278157ec0 con 0x7f027815b6a0 2023-09-28T00:15:05.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.902+0000 7f02697fa700 1 -- 172.21.15.190:0/4269457281 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0270024070 con 0x7f027815b6a0 2023-09-28T00:15:05.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.902+0000 7f02697fa700 1 -- 172.21.15.190:0/4269457281 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f027001db80 con 0x7f027815b6a0 2023-09-28T00:15:05.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.902+0000 7f027e0d8700 1 -- 172.21.15.190:0/4269457281 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027804c3c0 con 0x7f027815b6a0 2023-09-28T00:15:05.906 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.904+0000 7f02697fa700 1 -- 172.21.15.190:0/4269457281 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f027001de20 con 0x7f027815b6a0 2023-09-28T00:15:05.959 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:05.959+0000 7f0f1e164180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-28T00:15:05.974 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:05.973+0000 7f35576ed180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-28T00:15:05.989 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.988+0000 7f027e0d8700 1 -- 172.21.15.190:0/4269457281 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "db77a77e-0529-4dcf-b72a-04f5023122cd", "id": 5} v 0) v1 -- 0x7f02780cda40 con 0x7f027815b6a0 2023-09-28T00:15:05.992 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.991+0000 7f02697fa700 1 -- 172.21.15.190:0/4269457281 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db77a77e-0529-4dcf-b72a-04f5023122cd", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0270027d80 con 0x7f027815b6a0 2023-09-28T00:15:05.992 INFO:teuthology.orchestra.run.smithi190.stdout:5 2023-09-28T00:15:05.993 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.992+0000 7f027e0d8700 1 -- 172.21.15.190:0/4269457281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f027815b6a0 msgr2=0x7f0278155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:05.993 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.992+0000 7f027e0d8700 1 --2- 172.21.15.190:0/4269457281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f027815b6a0 0x7f0278155410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0270013000 tx=0x7f0270019000 comp rx=0 tx=0).stop 2023-09-28T00:15:05.993 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.992+0000 7f027e0d8700 1 -- 172.21.15.190:0/4269457281 shutdown_connections 2023-09-28T00:15:05.994 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.992+0000 7f027e0d8700 1 --2- 172.21.15.190:0/4269457281 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f027815b6a0 0x7f0278155410 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.994 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.992+0000 7f027e0d8700 1 --2- 172.21.15.190:0/4269457281 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02781571e0 0x7f0278157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.994 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.992+0000 7f027e0d8700 1 --2- 172.21.15.190:0/4269457281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02781575b0 0x7f0278159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:05.994 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.992+0000 7f027e0d8700 1 -- 172.21.15.190:0/4269457281 >> 172.21.15.190:0/4269457281 conn(0x7f02780ce390 msgr2=0x7f0278151360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:05.994 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.992+0000 7f027e0d8700 1 -- 172.21.15.190:0/4269457281 shutdown_connections 2023-09-28T00:15:05.994 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:05.992+0000 7f027e0d8700 1 -- 172.21.15.190:0/4269457281 wait complete. 2023-09-28T00:15:06.006 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 4020afcb-34e5-4f45-a65e-b59ded668f59 6 2023-09-28T00:15:06.100 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:06.100+0000 7f0f1e164180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-28T00:15:06.118 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:06.117+0000 7f35576ed180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-28T00:15:06.124 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.123+0000 7fead80e0700 1 Processor -- start 2023-09-28T00:15:06.124 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.123+0000 7fead80e0700 1 -- start start 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.124+0000 7fead80e0700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fead0159500 0x7fead01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.124+0000 7fead80e0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead00b3fd0 0x7fead015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.124+0000 7fead80e0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead015dd20 con 0x7fead015d8e0 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.124+0000 7fead80e0700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00b1110 con 0x7fead0159500 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.124+0000 7fead80e0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead00b13b0 con 0x7fead00b3fd0 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.124+0000 7fead5e7c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fead0159500 0x7fead01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.124+0000 7fead567b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead00b3fd0 0x7fead015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.124+0000 7fead667d700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fead015d8e0 0x7fead00cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:56670/0 (socket says 172.21.15.190:56670) 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.124+0000 7fead667d700 1 -- 172.21.15.190:0/1765788122 learned_addr learned my addr 172.21.15.190:0/1765788122 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead5e7c700 1 -- 172.21.15.190:0/1765788122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead00b3fd0 msgr2=0x7fead015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:06.127 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead5e7c700 1 --2- 172.21.15.190:0/1765788122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead00b3fd0 0x7fead015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead5e7c700 1 -- 172.21.15.190:0/1765788122 >> v1:172.21.15.190:6789/0 conn(0x7fead015d8e0 legacy=0x7fead00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead5e7c700 1 -- 172.21.15.190:0/1765788122 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead00b1690 con 0x7fead0159500 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead4e7a700 1 -- 172.21.15.190:0/1765788122 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290339367 0 0) 0x7fead015dd20 con 0x7fead015d8e0 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead567b700 1 --2- 172.21.15.190:0/1765788122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead00b3fd0 0x7fead015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead5e7c700 1 --2- 172.21.15.190:0/1765788122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead0159500 0x7fead01598d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feac00098e0 tx=0x7feac00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a014976d4f733de6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead4e7a700 1 -- 172.21.15.190:0/1765788122 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000b640 con 0x7fead0159500 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead4e7a700 1 -- 172.21.15.190:0/1765788122 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac000b7a0 con 0x7fead0159500 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead4e7a700 1 -- 172.21.15.190:0/1765788122 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000bb40 con 0x7fead0159500 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead80e0700 1 -- 172.21.15.190:0/1765788122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead0159500 msgr2=0x7fead01598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.125+0000 7fead80e0700 1 --2- 172.21.15.190:0/1765788122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead0159500 0x7fead01598d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feac00098e0 tx=0x7feac00091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.126+0000 7fead80e0700 1 -- 172.21.15.190:0/1765788122 shutdown_connections 2023-09-28T00:15:06.128 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.126+0000 7fead80e0700 1 --2- 172.21.15.190:0/1765788122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead0159500 0x7fead01598d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.126+0000 7fead80e0700 1 --2- 172.21.15.190:0/1765788122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead00b3fd0 0x7fead015d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.126+0000 7fead80e0700 1 -- 172.21.15.190:0/1765788122 >> 172.21.15.190:0/1765788122 conn(0x7fead0067630 msgr2=0x7fead0069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:06.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.126+0000 7fead80e0700 1 -- 172.21.15.190:0/1765788122 shutdown_connections 2023-09-28T00:15:06.129 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.126+0000 7fead80e0700 1 -- 172.21.15.190:0/1765788122 wait complete. 2023-09-28T00:15:06.131 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead80e0700 1 Processor -- start 2023-09-28T00:15:06.131 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead80e0700 1 -- start start 2023-09-28T00:15:06.131 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead80e0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead00b3fd0 0x7fead014b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.131 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead80e0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead0159500 0x7fead01598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.131 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead80e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead015d8e0 0x7fead015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.131 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead80e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead015b380 con 0x7fead015d8e0 2023-09-28T00:15:06.131 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead80e0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead014bdb0 con 0x7fead00b3fd0 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead80e0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead0159e10 con 0x7fead0159500 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead5e7c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead00b3fd0 0x7fead014b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead5e7c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead00b3fd0 0x7fead014b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:59080/0 (socket says 172.21.15.190:59080) 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead567b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead0159500 0x7fead01598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.127+0000 7fead5e7c700 1 -- 172.21.15.190:0/1160315695 learned_addr learned my addr 172.21.15.190:0/1160315695 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7fead667d700 1 --2- 172.21.15.190:0/1160315695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead015d8e0 0x7fead015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7fead5e7c700 1 -- 172.21.15.190:0/1160315695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead0159500 msgr2=0x7fead01598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7fead5e7c700 1 --2- 172.21.15.190:0/1160315695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead0159500 0x7fead01598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7fead5e7c700 1 -- 172.21.15.190:0/1160315695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead015d8e0 msgr2=0x7fead015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7fead5e7c700 1 --2- 172.21.15.190:0/1160315695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead015d8e0 0x7fead015bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7fead5e7c700 1 -- 172.21.15.190:0/1160315695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc009420 con 0x7fead00b3fd0 2023-09-28T00:15:06.132 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7fead5e7c700 1 --2- 172.21.15.190:0/1160315695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead00b3fd0 0x7fead014b870 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fead015deb0 tx=0x7feac0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:06.133 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7feac5ffb700 1 -- 172.21.15.190:0/1160315695 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0000d10 con 0x7fead00b3fd0 2023-09-28T00:15:06.133 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7feac5ffb700 1 -- 172.21.15.190:0/1160315695 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac000bb20 con 0x7fead00b3fd0 2023-09-28T00:15:06.133 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7feac5ffb700 1 -- 172.21.15.190:0/1160315695 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0011670 con 0x7fead00b3fd0 2023-09-28T00:15:06.133 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7fead80e0700 1 -- 172.21.15.190:0/1160315695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac0009420 con 0x7fead00b3fd0 2023-09-28T00:15:06.133 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7fead80e0700 1 -- 172.21.15.190:0/1160315695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead01574b0 con 0x7fead00b3fd0 2023-09-28T00:15:06.133 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7feac5ffb700 1 -- 172.21.15.190:0/1160315695 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7feac0011ca0 con 0x7fead00b3fd0 2023-09-28T00:15:06.133 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.128+0000 7feac5ffb700 1 -- 172.21.15.190:0/1160315695 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7feac00193b0 con 0x7fead00b3fd0 2023-09-28T00:15:06.133 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.129+0000 7fead80e0700 1 -- 172.21.15.190:0/1160315695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead0157280 con 0x7fead00b3fd0 2023-09-28T00:15:06.133 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.133+0000 7feac5ffb700 1 -- 172.21.15.190:0/1160315695 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7fead0157280 con 0x7fead00b3fd0 2023-09-28T00:15:06.199 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:06.199+0000 7f0f1e164180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-28T00:15:06.215 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.214+0000 7fead80e0700 1 -- 172.21.15.190:0/1160315695 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4020afcb-34e5-4f45-a65e-b59ded668f59", "id": 6} v 0) v1 -- 0x7fead0064050 con 0x7fead00b3fd0 2023-09-28T00:15:06.219 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:06.218+0000 7f35576ed180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-28T00:15:06.221 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.220+0000 7feac5ffb700 1 -- 172.21.15.190:0/1160315695 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4020afcb-34e5-4f45-a65e-b59ded668f59", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7feac0029070 con 0x7fead00b3fd0 2023-09-28T00:15:06.221 INFO:teuthology.orchestra.run.smithi190.stdout:6 2023-09-28T00:15:06.222 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.221+0000 7fead80e0700 1 -- 172.21.15.190:0/1160315695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead00b3fd0 msgr2=0x7fead014b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.222 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.221+0000 7fead80e0700 1 --2- 172.21.15.190:0/1160315695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead00b3fd0 0x7fead014b870 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fead015deb0 tx=0x7feac0017000 comp rx=0 tx=0).stop 2023-09-28T00:15:06.223 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.221+0000 7fead80e0700 1 -- 172.21.15.190:0/1160315695 shutdown_connections 2023-09-28T00:15:06.223 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.221+0000 7fead80e0700 1 --2- 172.21.15.190:0/1160315695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead015d8e0 0x7fead015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.223 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.221+0000 7fead80e0700 1 --2- 172.21.15.190:0/1160315695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead00b3fd0 0x7fead014b870 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.223 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.221+0000 7fead80e0700 1 --2- 172.21.15.190:0/1160315695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead0159500 0x7fead01598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.223 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.221+0000 7fead80e0700 1 -- 172.21.15.190:0/1160315695 >> 172.21.15.190:0/1160315695 conn(0x7fead0067630 msgr2=0x7fead0069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:06.223 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.221+0000 7fead80e0700 1 -- 172.21.15.190:0/1160315695 shutdown_connections 2023-09-28T00:15:06.223 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.221+0000 7fead80e0700 1 -- 172.21.15.190:0/1160315695 wait complete. 2023-09-28T00:15:06.234 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 37bf7abd-1f52-435b-a5b1-2ca5626c540d 7 2023-09-28T00:15:06.347 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.346+0000 7f6236975700 1 Processor -- start 2023-09-28T00:15:06.348 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.347+0000 7f6236975700 1 -- start start 2023-09-28T00:15:06.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.347+0000 7f6236975700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f62301598d0 0x7f623015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.351 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.347+0000 7f6236975700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f623015dd20 con 0x7f623015d8e0 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.347+0000 7f6236975700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62300b1110 con 0x7f6230159500 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.347+0000 7f6236975700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62300b13b0 con 0x7f62301598d0 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.347+0000 7f622ffff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6230159500 0x7f62300b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:56680/0 (socket says 172.21.15.190:56680) 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.347+0000 7f622ffff700 1 -- 172.21.15.190:0/713680848 learned_addr learned my addr 172.21.15.190:0/713680848 (peer_addr_for_me v1:172.21.15.190:0/0) 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686090578 0 0) 0x7f62300b1110 con 0x7f6230159500 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f621c003570 con 0x7f6230159500 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622f7fe700 1 --2- 172.21.15.190:0/713680848 >> v2:172.21.15.26:3300/0 conn(0x7f62301598d0 0x7f623015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508404219 0 0) 0x7f621c003570 con 0x7f6230159500 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 >> v2:172.21.15.26:3300/0 conn(0x7f62301598d0 msgr2=0x7f623015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 --2- 172.21.15.190:0/713680848 >> v2:172.21.15.26:3300/0 conn(0x7f62301598d0 0x7f623015d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 >> v1:172.21.15.26:6789/0 conn(0x7f623015d8e0 legacy=0x7f62300cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.352 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300b1690 con 0x7f6230159500 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7f6218001470 con 0x7f6230159500 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 >> v1:172.21.15.190:6789/0 conn(0x7f6230159500 legacy=0x7f62300b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f621c003a60 0x7f621c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c004810 0x7f621c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c0051c0 0x7f621c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300b13b0 con 0x7f621c004810 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c00c0d0 con 0x7f621c0051c0 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621c00c290 con 0x7f621c003a60 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622ffff700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f621c003a60 0x7f621c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f6234f12700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c0051c0 0x7f621c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622f7fe700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c004810 0x7f621c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.353 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622ffff700 1 -- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c0051c0 msgr2=0x7f621c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622ffff700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c0051c0 0x7f621c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622ffff700 1 -- 172.21.15.190:0/713680848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c004810 msgr2=0x7f621c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622ffff700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f621c004810 0x7f621c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f622ffff700 1 -- 172.21.15.190:0/713680848 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c003570 con 0x7f621c003a60 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f6234f12700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c0051c0 0x7f621c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.348+0000 7f6234f12700 1 -- 172.21.15.190:0/713680848 reap_dead start 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f622ffff700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f621c003a60 0x7f621c003e70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f621800c3c0 tx=0x7f6218001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f84cff892d1f18e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621800cc90 con 0x7f621c003a60 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621800cdf0 con 0x7f621c003a60 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f622effd700 1 -- 172.21.15.190:0/713680848 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218005b50 con 0x7f621c003a60 2023-09-28T00:15:06.354 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f6236975700 1 -- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f621c003a60 msgr2=0x7f621c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.355 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f6236975700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f621c003a60 0x7f621c003e70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f621800c3c0 tx=0x7f6218001e50 comp rx=0 tx=0).stop 2023-09-28T00:15:06.355 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f6236975700 1 -- 172.21.15.190:0/713680848 shutdown_connections 2023-09-28T00:15:06.355 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f6236975700 1 --2- 172.21.15.190:0/713680848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f621c003a60 0x7f621c003e70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.355 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f6236975700 1 -- 172.21.15.190:0/713680848 >> 172.21.15.190:0/713680848 conn(0x7f6230067630 msgr2=0x7f6230069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:06.355 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f6236975700 1 -- 172.21.15.190:0/713680848 shutdown_connections 2023-09-28T00:15:06.355 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.349+0000 7f6236975700 1 -- 172.21.15.190:0/713680848 wait complete. 2023-09-28T00:15:06.355 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.350+0000 7f6236975700 1 Processor -- start 2023-09-28T00:15:06.355 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f6236975700 1 -- start start 2023-09-28T00:15:06.357 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f6236975700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c003a60 0x7f6230150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.357 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f6236975700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623015c560 0x7f62301410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.357 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f6236975700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62300ceb90 0x7f62300cf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.357 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f6236975700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62300cf550 con 0x7f623015c560 2023-09-28T00:15:06.357 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f6236975700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6230169930 con 0x7f621c003a60 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f6236975700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6230141610 con 0x7f62300ceb90 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f6234f12700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62300ceb90 0x7f62300cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f622ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c003a60 0x7f6230150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f622ffff700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c003a60 0x7f6230150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:59086/0 (socket says 172.21.15.190:59086) 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f6234f12700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62300ceb90 0x7f62300cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:50406/0 (socket says 172.21.15.190:50406) 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.351+0000 7f622ffff700 1 -- 172.21.15.190:0/3786839814 learned_addr learned my addr 172.21.15.190:0/3786839814 (peer_addr_for_me v2:172.21.15.190:0/0) 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f622f7fe700 1 --2- 172.21.15.190:0/3786839814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623015c560 0x7f62301410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f622ffff700 1 -- 172.21.15.190:0/3786839814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62300ceb90 msgr2=0x7f62300cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f622ffff700 1 --2- 172.21.15.190:0/3786839814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62300ceb90 0x7f62300cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f622ffff700 1 -- 172.21.15.190:0/3786839814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623015c560 msgr2=0x7f62301410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f622ffff700 1 --2- 172.21.15.190:0/3786839814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623015c560 0x7f62301410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.358 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f622ffff700 1 -- 172.21.15.190:0/3786839814 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230150650 con 0x7f621c003a60 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f6234f12700 1 --2- 172.21.15.190:0/3786839814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62300ceb90 0x7f62300cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f622ffff700 1 --2- 172.21.15.190:0/3786839814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c003a60 0x7f6230150070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f621800c9b0 tx=0x7f6218015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f6227fff700 1 -- 172.21.15.190:0/3786839814 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621800cc90 con 0x7f621c003a60 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f6227fff700 1 -- 172.21.15.190:0/3786839814 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62180070d0 con 0x7f621c003a60 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f6227fff700 1 -- 172.21.15.190:0/3786839814 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6218007470 con 0x7f621c003a60 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f6236975700 1 -- 172.21.15.190:0/3786839814 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6230150930 con 0x7f621c003a60 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f6236975700 1 -- 172.21.15.190:0/3786839814 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6230150ef0 con 0x7f621c003a60 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f6227fff700 1 -- 172.21.15.190:0/3786839814 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f621801e6b0 con 0x7f621c003a60 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.352+0000 7f6227fff700 1 -- 172.21.15.190:0/3786839814 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f6218007ac0 con 0x7f621c003a60 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.353+0000 7f6236975700 1 -- 172.21.15.190:0/3786839814 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6230064050 con 0x7f621c003a60 2023-09-28T00:15:06.359 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.355+0000 7f6227fff700 1 -- 172.21.15.190:0/3786839814 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f6218024070 con 0x7f621c003a60 2023-09-28T00:15:06.438 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.437+0000 7f6236975700 1 -- 172.21.15.190:0/3786839814 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37bf7abd-1f52-435b-a5b1-2ca5626c540d", "id": 7} v 0) v1 -- 0x7f62300b1970 con 0x7f621c003a60 2023-09-28T00:15:06.446 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.445+0000 7f6227fff700 1 -- 172.21.15.190:0/3786839814 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37bf7abd-1f52-435b-a5b1-2ca5626c540d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6218017070 con 0x7f621c003a60 2023-09-28T00:15:06.446 INFO:teuthology.orchestra.run.smithi190.stdout:7 2023-09-28T00:15:06.447 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.446+0000 7f6236975700 1 -- 172.21.15.190:0/3786839814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c003a60 msgr2=0x7f6230150070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.447 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.446+0000 7f6236975700 1 --2- 172.21.15.190:0/3786839814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c003a60 0x7f6230150070 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f621800c9b0 tx=0x7f6218015000 comp rx=0 tx=0).stop 2023-09-28T00:15:06.447 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.446+0000 7f6236975700 1 -- 172.21.15.190:0/3786839814 shutdown_connections 2023-09-28T00:15:06.448 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.446+0000 7f6236975700 1 --2- 172.21.15.190:0/3786839814 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62300ceb90 0x7f62300cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.448 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.446+0000 7f6236975700 1 --2- 172.21.15.190:0/3786839814 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f621c003a60 0x7f6230150070 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.448 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.446+0000 7f6236975700 1 --2- 172.21.15.190:0/3786839814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f623015c560 0x7f62301410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.448 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.446+0000 7f6236975700 1 -- 172.21.15.190:0/3786839814 >> 172.21.15.190:0/3786839814 conn(0x7f6230067630 msgr2=0x7f623014d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:06.448 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.446+0000 7f6236975700 1 -- 172.21.15.190:0/3786839814 shutdown_connections 2023-09-28T00:15:06.448 INFO:teuthology.orchestra.run.smithi190.stderr:2023-09-28T00:15:06.446+0000 7f6236975700 1 -- 172.21.15.190:0/3786839814 wait complete. 2023-09-28T00:15:06.458 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-28T00:15:06.459 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-28T00:15:06.461 INFO:tasks.ceph.osd.0:Started 2023-09-28T00:15:06.461 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-28T00:15:06.461 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-28T00:15:06.463 INFO:tasks.ceph.osd.1:Started 2023-09-28T00:15:06.463 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-28T00:15:06.463 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-28T00:15:06.465 INFO:tasks.ceph.osd.2:Started 2023-09-28T00:15:06.465 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-28T00:15:06.465 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-28T00:15:06.467 INFO:tasks.ceph.osd.3:Started 2023-09-28T00:15:06.467 INFO:tasks.ceph.osd.4:Restarting daemon 2023-09-28T00:15:06.467 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-09-28T00:15:06.469 INFO:tasks.ceph.osd.4:Started 2023-09-28T00:15:06.470 INFO:tasks.ceph.osd.5:Restarting daemon 2023-09-28T00:15:06.470 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-09-28T00:15:06.472 INFO:tasks.ceph.osd.5:Started 2023-09-28T00:15:06.472 INFO:tasks.ceph.osd.6:Restarting daemon 2023-09-28T00:15:06.472 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-09-28T00:15:06.474 INFO:tasks.ceph.osd.6:Started 2023-09-28T00:15:06.474 INFO:tasks.ceph.osd.7:Restarting daemon 2023-09-28T00:15:06.474 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-09-28T00:15:06.476 INFO:tasks.ceph.osd.7:Started 2023-09-28T00:15:06.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:06.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.627+0000 7f018c8f7700 1 Processor -- start 2023-09-28T00:15:06.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.627+0000 7f018c8f7700 1 -- start start 2023-09-28T00:15:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f018c8f7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188159740 0x7f018815d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f018c8f7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01880ca6b0 0x7f0188068ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f018c8f7700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0188069ef0 con 0x7f0188069410 2023-09-28T00:15:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f018c8f7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0188069890 con 0x7f01880ca6b0 2023-09-28T00:15:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f018c8f7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018815d8e0 con 0x7f0188159740 2023-09-28T00:15:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f0185d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01880ca6b0 0x7f0188068ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f0185d9b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01880ca6b0 0x7f0188068ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57306/0 (socket says 172.21.15.26:57306) 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f0185d9b700 1 -- 172.21.15.26:0/3042865159 learned_addr learned my addr 172.21.15.26:0/3042865159 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f018659c700 1 --2- 172.21.15.26:0/3042865159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188159740 0x7f018815d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f0185d9b700 1 -- 172.21.15.26:0/3042865159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188159740 msgr2=0x7f018815d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f0185d9b700 1 --2- 172.21.15.26:0/3042865159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188159740 0x7f018815d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f0185d9b700 1 -- 172.21.15.26:0/3042865159 >> v1:172.21.15.190:6789/0 conn(0x7f0188069410 legacy=0x7f0188159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f0185d9b700 1 -- 172.21.15.26:0/3042865159 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018815dbc0 con 0x7f01880ca6b0 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.628+0000 7f0185d9b700 1 --2- 172.21.15.26:0/3042865159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 0x7f0188068ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f017c0099b0 tx=0x7f017c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52e2dec00dcd7d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.629+0000 7f018559a700 1 -- 172.21.15.26:0/3042865159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c009ea0 con 0x7f01880ca6b0 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.629+0000 7f018559a700 1 -- 172.21.15.26:0/3042865159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c00b860 con 0x7f01880ca6b0 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.629+0000 7f018559a700 1 -- 172.21.15.26:0/3042865159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00bc00 con 0x7f01880ca6b0 2023-09-28T00:15:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.629+0000 7f018c8f7700 1 -- 172.21.15.26:0/3042865159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 msgr2=0x7f0188068ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.629+0000 7f018c8f7700 1 --2- 172.21.15.26:0/3042865159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 0x7f0188068ed0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f017c0099b0 tx=0x7f017c009250 comp rx=0 tx=0).stop 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.630+0000 7f018c8f7700 1 -- 172.21.15.26:0/3042865159 shutdown_connections 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.630+0000 7f018c8f7700 1 --2- 172.21.15.26:0/3042865159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188159740 0x7f018815d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.630+0000 7f018c8f7700 1 --2- 172.21.15.26:0/3042865159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 0x7f0188068ed0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.630+0000 7f018c8f7700 1 -- 172.21.15.26:0/3042865159 >> 172.21.15.26:0/3042865159 conn(0x7f01880c9fc0 msgr2=0x7f018806de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.630+0000 7f018c8f7700 1 -- 172.21.15.26:0/3042865159 shutdown_connections 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.630+0000 7f018c8f7700 1 -- 172.21.15.26:0/3042865159 wait complete. 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.631+0000 7f018c8f7700 1 Processor -- start 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.631+0000 7f018c8f7700 1 -- start start 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f018c8f7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188069410 0x7f0188147540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f018c8f7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 0x7f0188147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f018c8f7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188159740 0x7f01881583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f018c8f7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188148ca0 con 0x7f01880ca6b0 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f018c8f7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018815c150 con 0x7f0188159740 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f018c8f7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01881486e0 con 0x7f0188069410 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0185d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 0x7f0188147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0185d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 0x7f0188147d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57314/0 (socket says 172.21.15.26:57314) 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0185d9b700 1 -- 172.21.15.26:0/3902822680 learned_addr learned my addr 172.21.15.26:0/3902822680 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f018659c700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188069410 0x7f0188147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0186d9d700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188159740 0x7f01881583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0185d9b700 1 -- 172.21.15.26:0/3902822680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188069410 msgr2=0x7f0188147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0185d9b700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188069410 0x7f0188147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0185d9b700 1 -- 172.21.15.26:0/3902822680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188159740 msgr2=0x7f01881583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0185d9b700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188159740 0x7f01881583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0185d9b700 1 -- 172.21.15.26:0/3902822680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0094f0 con 0x7f01880ca6b0 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0186d9d700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188159740 0x7f01881583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f0185d9b700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 0x7f0188147d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f01880711b0 tx=0x7f017c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f01767fc700 1 -- 172.21.15.26:0/3902822680 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c00bbe0 con 0x7f01880ca6b0 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f01767fc700 1 -- 172.21.15.26:0/3902822680 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017c011420 con 0x7f01880ca6b0 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.633+0000 7f018c8f7700 1 -- 172.21.15.26:0/3902822680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01881489c0 con 0x7f01880ca6b0 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.634+0000 7f01767fc700 1 -- 172.21.15.26:0/3902822680 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c0117c0 con 0x7f01880ca6b0 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.634+0000 7f018c8f7700 1 -- 172.21.15.26:0/3902822680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0188147a80 con 0x7f01880ca6b0 2023-09-28T00:15:06.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.634+0000 7f01767fc700 1 -- 172.21.15.26:0/3902822680 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f017c02e3f0 con 0x7f01880ca6b0 2023-09-28T00:15:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.634+0000 7f01767fc700 1 -- 172.21.15.26:0/3902822680 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f017c025ad0 con 0x7f01880ca6b0 2023-09-28T00:15:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.635+0000 7f018c8f7700 1 -- 172.21.15.26:0/3902822680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018815bc40 con 0x7f01880ca6b0 2023-09-28T00:15:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.637+0000 7f01767fc700 1 -- 172.21.15.26:0/3902822680 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f018815bc40 con 0x7f01880ca6b0 2023-09-28T00:15:06.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.706+0000 7f018c8f7700 1 -- 172.21.15.26:0/3902822680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0188064050 con 0x7f01880ca6b0 2023-09-28T00:15:06.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.707+0000 7f01767fc700 1 -- 172.21.15.26:0/3902822680 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f017c033060 con 0x7f01880ca6b0 2023-09-28T00:15:06.707 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:06.707 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":10,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:06.439998+0000","last_up_change":"0.000000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:06.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.708+0000 7f018c8f7700 1 -- 172.21.15.26:0/3902822680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 msgr2=0x7f0188147d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:06.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.708+0000 7f018c8f7700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 0x7f0188147d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f01880711b0 tx=0x7f017c017000 comp rx=0 tx=0).stop 2023-09-28T00:15:06.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.708+0000 7f018c8f7700 1 -- 172.21.15.26:0/3902822680 shutdown_connections 2023-09-28T00:15:06.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.708+0000 7f018c8f7700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0188069410 0x7f0188147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.708+0000 7f018c8f7700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0188159740 0x7f01881583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.708+0000 7f018c8f7700 1 --2- 172.21.15.26:0/3902822680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01880ca6b0 0x7f0188147d70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.708+0000 7f018c8f7700 1 -- 172.21.15.26:0/3902822680 >> 172.21.15.26:0/3902822680 conn(0x7f01880c9fc0 msgr2=0x7f0188154040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.708+0000 7f018c8f7700 1 -- 172.21.15.26:0/3902822680 shutdown_connections 2023-09-28T00:15:06.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:06.708+0000 7f018c8f7700 1 -- 172.21.15.26:0/3902822680 wait complete. 2023-09-28T00:15:06.720 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-28T00:15:06.720 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-28T00:15:06.771 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:06.771+0000 7f0f1e164180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-28T00:15:06.773 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:06.772+0000 7f35576ed180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-28T00:15:06.827 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-09-28T00:15:06.827+0000 7efc81fa7540 -1 Falling back to public interface 2023-09-28T00:15:06.851 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:06.850+0000 7f35576ed180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-28T00:15:06.855 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:06.856+0000 7f0f1e164180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-28T00:15:06.928 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:06.927+0000 7f35576ed180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-28T00:15:06.936 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:06.937+0000 7f0f1e164180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-28T00:15:07.070 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-09-28T00:15:07.070+0000 7f7736086540 -1 Falling back to public interface 2023-09-28T00:15:07.070 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-09-28T00:15:07.069+0000 7f986c9ea540 -1 Falling back to public interface 2023-09-28T00:15:07.078 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-09-28T00:15:07.077+0000 7f41f7274540 -1 Falling back to public interface 2023-09-28T00:15:07.078 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-09-28T00:15:07.078+0000 7f68438e1540 -1 Falling back to public interface 2023-09-28T00:15:07.084 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-09-28T00:15:07.084+0000 7efd467fc540 -1 Falling back to public interface 2023-09-28T00:15:07.086 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-09-28T00:15:07.085+0000 7f4a25407540 -1 Falling back to public interface 2023-09-28T00:15:07.088 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-09-28T00:15:07.088+0000 7f8444621540 -1 Falling back to public interface 2023-09-28T00:15:07.504 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:07.503+0000 7f35576ed180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-28T00:15:07.526 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:07.552 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:07.552+0000 7f0f1e164180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-28T00:15:07.637 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.637+0000 7f5c61232700 1 Processor -- start 2023-09-28T00:15:07.637 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.637+0000 7f5c61232700 1 -- start start 2023-09-28T00:15:07.639 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c61232700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5c5c0c3ae0 0x7f5c5c162510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c61232700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c0cd7d0 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c61232700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5c0ca2f0 con 0x7f5c5c157a70 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c61232700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5c0cf610 con 0x7f5c5c0c3ae0 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c5a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5c5c0cf1c0 0x7f5c5c0c33d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37512/0 (socket says 172.21.15.26:37512) 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c5a59c700 1 -- 172.21.15.26:0/2570271477 learned_addr learned my addr 172.21.15.26:0/2570271477 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c5b59e700 1 --2- 172.21.15.26:0/2570271477 >> v2:172.21.15.190:3300/0 conn(0x7f5c5c0c3ae0 0x7f5c5c162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c59d9b700 1 -- 172.21.15.26:0/2570271477 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760915934 0 0) 0x7f5c5c0cd7d0 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c59d9b700 1 -- 172.21.15.26:0/2570271477 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c44003570 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c59d9b700 1 -- 172.21.15.26:0/2570271477 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576610 0 0) 0x7f5c5c0ca2f0 con 0x7f5c5c157a70 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c59d9b700 1 -- 172.21.15.26:0/2570271477 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c5c0cd7d0 con 0x7f5c5c157a70 2023-09-28T00:15:07.640 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c5b59e700 1 -- 172.21.15.26:0/2570271477 >> v1:172.21.15.190:6789/0 conn(0x7f5c5c157a70 legacy=0x7f5c5c0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c5b59e700 1 -- 172.21.15.26:0/2570271477 >> v1:172.21.15.26:6789/0 conn(0x7f5c5c0cf1c0 legacy=0x7f5c5c0c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c5b59e700 1 -- 172.21.15.26:0/2570271477 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c0cd4f0 con 0x7f5c5c0c3ae0 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.638+0000 7f5c5b59e700 1 --2- 172.21.15.26:0/2570271477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0c3ae0 0x7f5c5c162510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009e60 tx=0x7f5c54009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53f69989f5db5c9d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c59d9b700 1 -- 172.21.15.26:0/2570271477 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5400e070 con 0x7f5c5c0c3ae0 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c59d9b700 1 -- 172.21.15.26:0/2570271477 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5400bb40 con 0x7f5c5c0c3ae0 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c59d9b700 1 -- 172.21.15.26:0/2570271477 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54012430 con 0x7f5c5c0c3ae0 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c61232700 1 -- 172.21.15.26:0/2570271477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0c3ae0 msgr2=0x7f5c5c162510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c61232700 1 --2- 172.21.15.26:0/2570271477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0c3ae0 0x7f5c5c162510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009e60 tx=0x7f5c54009780 comp rx=0 tx=0).stop 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c61232700 1 -- 172.21.15.26:0/2570271477 shutdown_connections 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c61232700 1 --2- 172.21.15.26:0/2570271477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0c3ae0 0x7f5c5c162510 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:07.641 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c61232700 1 -- 172.21.15.26:0/2570271477 >> 172.21.15.26:0/2570271477 conn(0x7f5c5c087ff0 msgr2=0x7f5c5c0ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:07.642 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c61232700 1 -- 172.21.15.26:0/2570271477 shutdown_connections 2023-09-28T00:15:07.642 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.639+0000 7f5c61232700 1 -- 172.21.15.26:0/2570271477 wait complete. 2023-09-28T00:15:07.642 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:07.641+0000 7f35576ed180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-28T00:15:07.645 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.640+0000 7f5c61232700 1 Processor -- start 2023-09-28T00:15:07.645 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.640+0000 7f5c61232700 1 -- start start 2023-09-28T00:15:07.645 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c61232700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c5c0c3ae0 0x7f5c5c152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:07.645 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c61232700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0cf1c0 0x7f5c5c0c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:07.645 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c61232700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c157a70 0x7f5c5c0c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:07.645 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c61232700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c099370 con 0x7f5c5c157a70 2023-09-28T00:15:07.645 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c61232700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c099500 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c61232700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c153420 con 0x7f5c5c0c3ae0 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c5b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c157a70 0x7f5c5c0c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c5a59c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0cf1c0 0x7f5c5c0c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c5b59e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c157a70 0x7f5c5c0c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57318/0 (socket says 172.21.15.26:57318) 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c5b59e700 1 -- 172.21.15.26:0/420113079 learned_addr learned my addr 172.21.15.26:0/420113079 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.641+0000 7f5c5ad9d700 1 --2- 172.21.15.26:0/420113079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c5c0c3ae0 0x7f5c5c152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c5a59c700 1 -- 172.21.15.26:0/420113079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c5c0c3ae0 msgr2=0x7f5c5c152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c5a59c700 1 --2- 172.21.15.26:0/420113079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c5c0c3ae0 0x7f5c5c152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c5a59c700 1 -- 172.21.15.26:0/420113079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c157a70 msgr2=0x7f5c5c0c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c5a59c700 1 --2- 172.21.15.26:0/420113079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c157a70 0x7f5c5c0c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:07.646 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c5a59c700 1 -- 172.21.15.26:0/420113079 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54009a20 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c5b59e700 1 --2- 172.21.15.26:0/420113079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c157a70 0x7f5c5c0c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c5a59c700 1 --2- 172.21.15.26:0/420113079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0cf1c0 0x7f5c5c0c56e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c580 tx=0x7f5c50007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c42ffd700 1 -- 172.21.15.26:0/420113079 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50005b30 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c42ffd700 1 -- 172.21.15.26:0/420113079 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50005c90 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c61232700 1 -- 172.21.15.26:0/420113079 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c5c0c6940 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c42ffd700 1 -- 172.21.15.26:0/420113079 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50007300 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c61232700 1 -- 172.21.15.26:0/420113079 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5c0c6f00 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c42ffd700 1 -- 172.21.15.26:0/420113079 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5c5001c440 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.642+0000 7f5c42ffd700 1 -- 172.21.15.26:0/420113079 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f5c50005e00 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.647 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.643+0000 7f5c61232700 1 -- 172.21.15.26:0/420113079 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5c0c9c70 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.648 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.645+0000 7f5c42ffd700 1 -- 172.21.15.26:0/420113079 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71325 (secure 0 0 0) 0x7f5c50017070 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.700 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:07.700+0000 7f0f1e164180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-28T00:15:07.715 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.716+0000 7f5c61232700 1 -- 172.21.15.26:0/420113079 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c5c068e50 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.716 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.716+0000 7f5c42ffd700 1 -- 172.21.15.26:0/420113079 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5c5001c6f0 con 0x7f5c5c0cf1c0 2023-09-28T00:15:07.716 INFO:teuthology.misc.health.smithi026.stdout: 2023-09-28T00:15:07.717 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":10,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:06.439998+0000","last_up_change":"0.000000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:07.718 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.717+0000 7f5c61232700 1 -- 172.21.15.26:0/420113079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0cf1c0 msgr2=0x7f5c5c0c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:07.718 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.717+0000 7f5c61232700 1 --2- 172.21.15.26:0/420113079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0cf1c0 0x7f5c5c0c56e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c580 tx=0x7f5c50007d90 comp rx=0 tx=0).stop 2023-09-28T00:15:07.718 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.717+0000 7f5c61232700 1 -- 172.21.15.26:0/420113079 shutdown_connections 2023-09-28T00:15:07.718 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.717+0000 7f5c61232700 1 --2- 172.21.15.26:0/420113079 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c5c0c3ae0 0x7f5c5c152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:07.718 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.717+0000 7f5c61232700 1 --2- 172.21.15.26:0/420113079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c5c157a70 0x7f5c5c0c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:07.718 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.717+0000 7f5c61232700 1 --2- 172.21.15.26:0/420113079 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c5c0cf1c0 0x7f5c5c0c56e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:07.718 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.717+0000 7f5c61232700 1 -- 172.21.15.26:0/420113079 >> 172.21.15.26:0/420113079 conn(0x7f5c5c087ff0 msgr2=0x7f5c5c0680c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:07.718 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.718+0000 7f5c61232700 1 -- 172.21.15.26:0/420113079 shutdown_connections 2023-09-28T00:15:07.718 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:07.718+0000 7f5c61232700 1 -- 172.21.15.26:0/420113079 wait complete. 2023-09-28T00:15:07.728 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-09-28T00:15:07.728 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:07.728+0000 7f35576ed180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-28T00:15:07.799 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:07.799+0000 7f0f1e164180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-28T00:15:07.976 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:07.975+0000 7f35576ed180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-28T00:15:08.053 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:08.053+0000 7f35576ed180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-28T00:15:08.056 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:08.057+0000 7f0f1e164180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-28T00:15:08.138 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:08.138+0000 7f0f1e164180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-28T00:15:08.883 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:08.883+0000 7f35576ed180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-28T00:15:08.956 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:08.955+0000 7f35576ed180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-28T00:15:09.003 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:09.004+0000 7f0f1e164180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-28T00:15:09.031 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:09.031+0000 7f35576ed180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-28T00:15:09.083 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:09.083+0000 7f0f1e164180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-28T00:15:09.160 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:09.160+0000 7f0f1e164180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-28T00:15:09.163 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:09.163+0000 7f35576ed180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-28T00:15:09.247 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:09.246+0000 7f35576ed180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-28T00:15:09.302 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:09.302+0000 7f0f1e164180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-28T00:15:09.398 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:09.397+0000 7f35576ed180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-28T00:15:09.399 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:09.400+0000 7f0f1e164180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-28T00:15:09.472 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:09.471+0000 7f35576ed180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-28T00:15:09.559 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:09.558+0000 7f35576ed180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-28T00:15:09.563 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:09.563+0000 7f0f1e164180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-28T00:15:09.642 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:09.643+0000 7f0f1e164180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-28T00:15:09.644 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:09.644+0000 7f35576ed180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-28T00:15:09.722 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:09.722+0000 7f0f1e164180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-28T00:15:09.808 INFO:tasks.ceph.mgr.y.smithi026.stderr:2023-09-28T00:15:09.808+0000 7f0f1e164180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-28T00:15:10.069 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-09-28T00:15:10.069+0000 7efc81fa7540 -1 osd.2 0 log_to_monitors true 2023-09-28T00:15:10.313 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-09-28T00:15:10.313+0000 7f986c9ea540 -1 osd.4 0 log_to_monitors true 2023-09-28T00:15:10.541 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-09-28T00:15:10.541+0000 7f41f7274540 -1 osd.7 0 log_to_monitors true 2023-09-28T00:15:10.542 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-09-28T00:15:10.542+0000 7f7736086540 -1 osd.1 0 log_to_monitors true 2023-09-28T00:15:10.585 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-09-28T00:15:10.584+0000 7f4a25407540 -1 osd.5 0 log_to_monitors true 2023-09-28T00:15:10.588 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-09-28T00:15:10.588+0000 7f68438e1540 -1 osd.0 0 log_to_monitors true 2023-09-28T00:15:10.596 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-09-28T00:15:10.597+0000 7efd467fc540 -1 osd.3 0 log_to_monitors true 2023-09-28T00:15:10.644 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-09-28T00:15:10.644+0000 7f8444621540 -1 osd.6 0 log_to_monitors true 2023-09-28T00:15:10.668 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:10.668+0000 7f3510af4700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-28T00:15:10.669 INFO:tasks.ceph.mgr.x.smithi190.stderr:2023-09-28T00:15:10.669+0000 7f3510af4700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-28T00:15:13.132 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-09-28T00:15:13.132+0000 7efc78bc9700 -1 osd.2 0 waiting for initial osdmap 2023-09-28T00:15:13.136 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-09-28T00:15:13.136+0000 7f772cca8700 -1 osd.1 0 waiting for initial osdmap 2023-09-28T00:15:13.138 INFO:tasks.ceph.osd.2.smithi026.stderr:2023-09-28T00:15:13.138+0000 7efc719c0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:15:13.140 INFO:tasks.ceph.osd.1.smithi026.stderr:2023-09-28T00:15:13.140+0000 7f7725a9f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:15:13.140 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-09-28T00:15:13.141+0000 7f683bd06700 -1 osd.0 0 waiting for initial osdmap 2023-09-28T00:15:13.158 INFO:tasks.ceph.osd.0.smithi026.stderr:2023-09-28T00:15:13.159+0000 7f68332fa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:15:13.197 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-09-28T00:15:13.197+0000 7efd3d41e700 -1 osd.3 0 waiting for initial osdmap 2023-09-28T00:15:13.200 INFO:tasks.ceph.osd.3.smithi026.stderr:2023-09-28T00:15:13.200+0000 7efd36215700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:15:13.830 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-09-28T00:15:13.830+0000 7f41ede96700 -1 osd.7 0 waiting for initial osdmap 2023-09-28T00:15:13.835 INFO:tasks.ceph.osd.7.smithi190.stderr:2023-09-28T00:15:13.835+0000 7f41e6c8d700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:15:13.849 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-09-28T00:15:13.849+0000 7f4a1d82c700 -1 osd.5 0 waiting for initial osdmap 2023-09-28T00:15:13.856 INFO:tasks.ceph.osd.5.smithi190.stderr:2023-09-28T00:15:13.857+0000 7f4a14e20700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:15:13.857 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-09-28T00:15:13.857+0000 7f843b243700 -1 osd.6 0 waiting for initial osdmap 2023-09-28T00:15:13.860 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-09-28T00:15:13.860+0000 7f986360c700 -1 osd.4 0 waiting for initial osdmap 2023-09-28T00:15:13.861 INFO:tasks.ceph.osd.6.smithi190.stderr:2023-09-28T00:15:13.861+0000 7f843403a700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:15:13.864 INFO:tasks.ceph.osd.4.smithi190.stderr:2023-09-28T00:15:13.864+0000 7f985c403700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-28T00:15:14.534 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:14.657 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.657+0000 7f27a754c700 1 Processor -- start 2023-09-28T00:15:14.657 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.657+0000 7f27a754c700 1 -- start start 2023-09-28T00:15:14.660 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.658+0000 7f27a754c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f27a00c9900 0x7f27a006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:14.660 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.658+0000 7f27a754c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f27a00cd290 0x7f27a00cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:14.660 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.658+0000 7f27a754c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a00b0880 con 0x7f27a00c9cd0 2023-09-28T00:15:14.660 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.658+0000 7f27a754c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a0156a60 con 0x7f27a00c9900 2023-09-28T00:15:14.661 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.658+0000 7f27a754c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a00b1080 con 0x7f27a00cd290 2023-09-28T00:15:14.661 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.658+0000 7f27a52e8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f27a00c9900 0x7f27a006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:14.661 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.658+0000 7f27a4ae7700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f27a00c9cd0 0x7f27a00b0170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:36942/0 (socket says 172.21.15.26:36942) 2023-09-28T00:15:14.661 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f27a4ae7700 1 -- 172.21.15.26:0/1821157675 learned_addr learned my addr 172.21.15.26:0/1821157675 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:14.661 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f27a5ae9700 1 --2- 172.21.15.26:0/1821157675 >> v2:172.21.15.190:3300/0 conn(0x7f27a00cd290 0x7f27a00cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:14.661 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f27a52e8700 1 -- 172.21.15.26:0/1821157675 >> v2:172.21.15.190:3300/0 conn(0x7f27a00cd290 msgr2=0x7f27a00cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:14.661 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f27a52e8700 1 --2- 172.21.15.26:0/1821157675 >> v2:172.21.15.190:3300/0 conn(0x7f27a00cd290 0x7f27a00cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:14.661 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f27a52e8700 1 -- 172.21.15.26:0/1821157675 >> v1:172.21.15.26:6789/0 conn(0x7f27a00c9cd0 legacy=0x7f27a00b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:14.661 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f27a52e8700 1 -- 172.21.15.26:0/1821157675 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a00cdbf0 con 0x7f27a00c9900 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f279ffff700 1 -- 172.21.15.26:0/1821157675 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626963252 0 0) 0x7f2794001110 con 0x7f27a00c9cd0 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f27a52e8700 1 --2- 172.21.15.26:0/1821157675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9900 0x7f27a006b720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f27a015b1c0 tx=0x7f2798009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d82429f6ff2ac server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f279ffff700 1 -- 172.21.15.26:0/1821157675 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f279800e070 con 0x7f27a00c9900 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f279ffff700 1 -- 172.21.15.26:0/1821157675 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f279800bb60 con 0x7f27a00c9900 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.659+0000 7f279ffff700 1 -- 172.21.15.26:0/1821157675 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798012430 con 0x7f27a00c9900 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.660+0000 7f27a754c700 1 -- 172.21.15.26:0/1821157675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9900 msgr2=0x7f27a006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.660+0000 7f27a754c700 1 --2- 172.21.15.26:0/1821157675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9900 0x7f27a006b720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f27a015b1c0 tx=0x7f2798009780 comp rx=0 tx=0).stop 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.660+0000 7f27a754c700 1 -- 172.21.15.26:0/1821157675 shutdown_connections 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.660+0000 7f27a754c700 1 --2- 172.21.15.26:0/1821157675 >> v2:172.21.15.190:3300/0 conn(0x7f27a00cd290 0x7f27a00cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:14.662 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.660+0000 7f27a754c700 1 --2- 172.21.15.26:0/1821157675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9900 0x7f27a006b720 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:14.663 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.660+0000 7f27a754c700 1 -- 172.21.15.26:0/1821157675 >> 172.21.15.26:0/1821157675 conn(0x7f27a0068130 msgr2=0x7f27a006d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:14.663 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.660+0000 7f27a754c700 1 -- 172.21.15.26:0/1821157675 shutdown_connections 2023-09-28T00:15:14.663 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.660+0000 7f27a754c700 1 -- 172.21.15.26:0/1821157675 wait complete. 2023-09-28T00:15:14.666 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.661+0000 7f27a754c700 1 Processor -- start 2023-09-28T00:15:14.666 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.661+0000 7f27a754c700 1 -- start start 2023-09-28T00:15:14.666 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a754c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27a00c9900 0x7f27a00c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:14.666 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a754c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9cd0 0x7f27a0145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:14.666 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a754c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27a00cd290 0x7f27a01686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:14.666 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a754c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00a5870 con 0x7f27a00c9cd0 2023-09-28T00:15:14.666 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a754c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0146430 con 0x7f27a00c9900 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a754c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a00cb330 con 0x7f27a00cd290 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a4ae7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9cd0 0x7f27a0145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a4ae7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9cd0 0x7f27a0145ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38346/0 (socket says 172.21.15.26:38346) 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a4ae7700 1 -- 172.21.15.26:0/3214987795 learned_addr learned my addr 172.21.15.26:0/3214987795 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a52e8700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27a00c9900 0x7f27a00c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a4ae7700 1 -- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27a00cd290 msgr2=0x7f27a01686f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a4ae7700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27a00cd290 0x7f27a01686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a4ae7700 1 -- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27a00c9900 msgr2=0x7f27a00c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a4ae7700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27a00c9900 0x7f27a00c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:14.667 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a4ae7700 1 -- 172.21.15.26:0/3214987795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2798009a20 con 0x7f27a00c9cd0 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.662+0000 7f27a52e8700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27a00c9900 0x7f27a00c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.663+0000 7f27a4ae7700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9cd0 0x7f27a0145ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f279400c7e0 tx=0x7f2794007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.663+0000 7f279d7fa700 1 -- 172.21.15.26:0/3214987795 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794005b30 con 0x7f27a00c9cd0 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.663+0000 7f279d7fa700 1 -- 172.21.15.26:0/3214987795 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2794005c90 con 0x7f27a00c9cd0 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.663+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a0168c30 con 0x7f27a00c9cd0 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.663+0000 7f279d7fa700 1 -- 172.21.15.26:0/3214987795 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2794007300 con 0x7f27a00c9cd0 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.663+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a00cb7c0 con 0x7f27a00c9cd0 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.664+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a0069d50 con 0x7f27a00c9cd0 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.664+0000 7f279d7fa700 1 -- 172.21.15.26:0/3214987795 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 84984+0+0 (secure 0 0 0) 0x7f279401b400 con 0x7f27a00c9cd0 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.665+0000 7f279d7fa700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f278c0672a0 0x7f278c069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:14.668 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.665+0000 7f279d7fa700 1 -- 172.21.15.26:0/3214987795 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3627+0+0 (secure 0 0 0) 0x7f2794083aa0 con 0x7f27a00c9cd0 2023-09-28T00:15:14.669 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.665+0000 7f27a52e8700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f278c0672a0 0x7f278c069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:14.669 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.665+0000 7f27a52e8700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f278c0672a0 0x7f278c069750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27a0154300 tx=0x7f2798019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:14.669 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.669+0000 7f279d7fa700 1 -- 172.21.15.26:0/3214987795 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2794051530 con 0x7f27a00c9cd0 2023-09-28T00:15:14.864 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.864+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27a00b0880 con 0x7f27a00c9cd0 2023-09-28T00:15:14.865 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.865+0000 7f279d7fa700 1 -- 172.21.15.26:0/3214987795 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+9118 (secure 0 0 0) 0x7f27a00b0880 con 0x7f27a00c9cd0 2023-09-28T00:15:14.865 INFO:teuthology.misc.health.smithi026.stdout: 2023-09-28T00:15:14.865 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":13,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:13.857530+0000","last_up_change":"2023-09-28T00:15:13.857530+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:14.867 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f278c0672a0 msgr2=0x7f278c069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f278c0672a0 0x7f278c069750 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27a0154300 tx=0x7f2798019000 comp rx=0 tx=0).stop 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9cd0 msgr2=0x7f27a0145ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9cd0 0x7f27a0145ef0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f279400c7e0 tx=0x7f2794007c30 comp rx=0 tx=0).stop 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 shutdown_connections 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f278c0672a0 0x7f278c069750 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f27a00cd290 0x7f27a01686f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f27a00c9900 0x7f27a00c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 --2- 172.21.15.26:0/3214987795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f27a00c9cd0 0x7f27a0145ef0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 >> 172.21.15.26:0/3214987795 conn(0x7f27a0068130 msgr2=0x7f27a0155e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:14.868 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 shutdown_connections 2023-09-28T00:15:14.869 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:14.867+0000 7f27a754c700 1 -- 172.21.15.26:0/3214987795 wait complete. 2023-09-28T00:15:14.880 DEBUG:teuthology.misc:5 of 8 OSDs are up 2023-09-28T00:15:21.686 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:21.808 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.807+0000 7f06e013e700 1 Processor -- start 2023-09-28T00:15:21.809 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.808+0000 7f06e013e700 1 -- start start 2023-09-28T00:15:21.811 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.808+0000 7f06e013e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f06d80caeb0 0x7f06d80d0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:21.811 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.808+0000 7f06e013e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80d1310 0x7f06d8159450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:21.811 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06e013e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d80cfeb0 con 0x7f06d80cb280 2023-09-28T00:15:21.811 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06e013e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d80cf2a0 con 0x7f06d80caeb0 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06e013e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80cf580 con 0x7f06d80d1310 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06ddeda700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f06d80caeb0 0x7f06d80d0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06de6db700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f06d80cb280 0x7f06d80ce1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47876/0 (socket says 172.21.15.26:47876) 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06ddeda700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f06d80caeb0 0x7f06d80d0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43038/0 (socket says 172.21.15.26:43038) 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06de6db700 1 -- 172.21.15.26:0/380960448 learned_addr learned my addr 172.21.15.26:0/380960448 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06dd6d9700 1 --2- 172.21.15.26:0/380960448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80d1310 0x7f06d8159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06ddeda700 1 -- 172.21.15.26:0/380960448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80d1310 msgr2=0x7f06d8159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06ddeda700 1 --2- 172.21.15.26:0/380960448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80d1310 0x7f06d8159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06ddeda700 1 -- 172.21.15.26:0/380960448 >> v1:172.21.15.26:6789/0 conn(0x7f06d80cb280 legacy=0x7f06d80ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06ddeda700 1 -- 172.21.15.26:0/380960448 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80cf860 con 0x7f06d80caeb0 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06dd6d9700 1 --2- 172.21.15.26:0/380960448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80d1310 0x7f06d8159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:21.812 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06dced8700 1 -- 172.21.15.26:0/380960448 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051587831 0 0) 0x7f06d80cfeb0 con 0x7f06d80cb280 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06ddeda700 1 --2- 172.21.15.26:0/380960448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80caeb0 0x7f06d80d0dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009e60 tx=0x7f06c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28d2399d606dcdb server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06dced8700 1 -- 172.21.15.26:0/380960448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800e070 con 0x7f06d80caeb0 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06dced8700 1 -- 172.21.15.26:0/380960448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c800bc30 con 0x7f06d80caeb0 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.809+0000 7f06dced8700 1 -- 172.21.15.26:0/380960448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8012430 con 0x7f06d80caeb0 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.810+0000 7f06e013e700 1 -- 172.21.15.26:0/380960448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80caeb0 msgr2=0x7f06d80d0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.810+0000 7f06e013e700 1 --2- 172.21.15.26:0/380960448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80caeb0 0x7f06d80d0dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009e60 tx=0x7f06c8009780 comp rx=0 tx=0).stop 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.810+0000 7f06e013e700 1 -- 172.21.15.26:0/380960448 shutdown_connections 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.810+0000 7f06e013e700 1 --2- 172.21.15.26:0/380960448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80caeb0 0x7f06d80d0dd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.810+0000 7f06e013e700 1 --2- 172.21.15.26:0/380960448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80d1310 0x7f06d8159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:21.813 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.810+0000 7f06e013e700 1 -- 172.21.15.26:0/380960448 >> 172.21.15.26:0/380960448 conn(0x7f06d806ce10 msgr2=0x7f06d80d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:21.814 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.810+0000 7f06e013e700 1 -- 172.21.15.26:0/380960448 shutdown_connections 2023-09-28T00:15:21.814 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.810+0000 7f06e013e700 1 -- 172.21.15.26:0/380960448 wait complete. 2023-09-28T00:15:21.816 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.811+0000 7f06e013e700 1 Processor -- start 2023-09-28T00:15:21.816 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.811+0000 7f06e013e700 1 -- start start 2023-09-28T00:15:21.816 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06e013e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d80caeb0 0x7f06d8169b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:21.817 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06e013e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80cb280 0x7f06d80b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:21.817 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06e013e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80d1310 0x7f06d80ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:21.817 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06e013e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80b53a0 con 0x7f06d80d1310 2023-09-28T00:15:21.817 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06e013e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d816a060 con 0x7f06d80caeb0 2023-09-28T00:15:21.817 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06e013e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d80b4790 con 0x7f06d80cb280 2023-09-28T00:15:21.817 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06de6db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80d1310 0x7f06d80ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:21.817 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06de6db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80d1310 0x7f06d80ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43042/0 (socket says 172.21.15.26:43042) 2023-09-28T00:15:21.817 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06de6db700 1 -- 172.21.15.26:0/1070630090 learned_addr learned my addr 172.21.15.26:0/1070630090 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:21.817 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06dd6d9700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80cb280 0x7f06d80b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:21.818 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06ddeda700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d80caeb0 0x7f06d8169b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:21.818 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06de6db700 1 -- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80cb280 msgr2=0x7f06d80b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:21.818 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06de6db700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80cb280 0x7f06d80b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:21.818 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06de6db700 1 -- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d80caeb0 msgr2=0x7f06d8169b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:21.818 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06de6db700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d80caeb0 0x7f06d8169b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:21.818 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06de6db700 1 -- 172.21.15.26:0/1070630090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c8009a20 con 0x7f06d80d1310 2023-09-28T00:15:21.818 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06dd6d9700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80cb280 0x7f06d80b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:21.818 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.812+0000 7f06ddeda700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d80caeb0 0x7f06d8169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:21.818 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.813+0000 7f06de6db700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80d1310 0x7f06d80ca070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c7e0 tx=0x7f06d0007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:21.819 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.813+0000 7f06d5ffb700 1 -- 172.21.15.26:0/1070630090 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0005c00 con 0x7f06d80d1310 2023-09-28T00:15:21.819 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.813+0000 7f06d5ffb700 1 -- 172.21.15.26:0/1070630090 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0005d60 con 0x7f06d80d1310 2023-09-28T00:15:21.819 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.813+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d80b4a70 con 0x7f06d80d1310 2023-09-28T00:15:21.819 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.813+0000 7f06d5ffb700 1 -- 172.21.15.26:0/1070630090 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0004a80 con 0x7f06d80d1310 2023-09-28T00:15:21.819 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.813+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d80b5030 con 0x7f06d80d1310 2023-09-28T00:15:21.819 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.814+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d80cc0e0 con 0x7f06d80d1310 2023-09-28T00:15:21.820 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.814+0000 7f06d5ffb700 1 -- 172.21.15.26:0/1070630090 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f06d0005030 con 0x7f06d80d1310 2023-09-28T00:15:21.820 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.815+0000 7f06d5ffb700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f06c4067330 0x7f06c40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:21.820 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.815+0000 7f06d5ffb700 1 -- 172.21.15.26:0/1070630090 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f06d0083b60 con 0x7f06d80d1310 2023-09-28T00:15:21.821 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.815+0000 7f06ddeda700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f06c4067330 0x7f06c40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:21.821 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.815+0000 7f06ddeda700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f06c4067330 0x7f06c40697e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009e60 tx=0x7f06c8019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:21.822 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:21.820+0000 7f06d5ffb700 1 -- 172.21.15.26:0/1070630090 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f06d004b570 con 0x7f06d80d1310 2023-09-28T00:15:22.017 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.016+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06d80cfb40 con 0x7f06d80d1310 2023-09-28T00:15:22.017 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.017+0000 7f06d5ffb700 1 -- 172.21.15.26:0/1070630090 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f06d0050f10 con 0x7f06d80d1310 2023-09-28T00:15:22.018 INFO:teuthology.misc.health.smithi026.stdout: 2023-09-28T00:15:22.018 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":17,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:17.926068+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.018+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f06c4067330 msgr2=0x7f06c40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.018+0000 7f06e013e700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f06c4067330 0x7f06c40697e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009e60 tx=0x7f06c8019000 comp rx=0 tx=0).stop 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.018+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80d1310 msgr2=0x7f06d80ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.018+0000 7f06e013e700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80d1310 0x7f06d80ca070 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c7e0 tx=0x7f06d0007d90 comp rx=0 tx=0).stop 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.019+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 shutdown_connections 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.019+0000 7f06e013e700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f06c4067330 0x7f06c40697e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.019+0000 7f06e013e700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06d80d1310 0x7f06d80ca070 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.019+0000 7f06e013e700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f06d80caeb0 0x7f06d8169b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.019+0000 7f06e013e700 1 --2- 172.21.15.26:0/1070630090 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f06d80cb280 0x7f06d80b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.020 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.019+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 >> 172.21.15.26:0/1070630090 conn(0x7f06d806ce10 msgr2=0x7f06d81573a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:22.021 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.019+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 shutdown_connections 2023-09-28T00:15:22.021 INFO:teuthology.misc.health.smithi026.stderr:2023-09-28T00:15:22.019+0000 7f06e013e700 1 -- 172.21.15.26:0/1070630090 wait complete. 2023-09-28T00:15:22.031 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-09-28T00:15:22.031 INFO:tasks.ceph:Creating RBD pool 2023-09-28T00:15:22.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-28T00:15:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.148+0000 7f787d5c4700 1 Processor -- start 2023-09-28T00:15:22.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.148+0000 7f787d5c4700 1 -- start start 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f787d5c4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7878159500 0x7f78781598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f787d5c4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78780b1110 con 0x7f78780b3fd0 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f787d5c4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78780b13b0 con 0x7f787815dab0 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f787d5c4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78780b1690 con 0x7f7878159500 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f7876ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7878159500 0x7f78781598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f78767fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f78780b3fd0 0x7f787815d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47892/0 (socket says 172.21.15.26:47892) 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f78767fc700 1 -- 172.21.15.26:0/2221573004 learned_addr learned my addr 172.21.15.26:0/2221573004 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f7876ffd700 1 -- 172.21.15.26:0/2221573004 >> v1:172.21.15.190:6789/0 conn(0x7f787815dab0 legacy=0x7f78780cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f7876ffd700 1 -- 172.21.15.26:0/2221573004 >> v1:172.21.15.26:6789/0 conn(0x7f78780b3fd0 legacy=0x7f787815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:22.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f7876ffd700 1 -- 172.21.15.26:0/2221573004 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78780b1970 con 0x7f7878159500 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f7875ffb700 1 -- 172.21.15.26:0/2221573004 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024084271 0 0) 0x7f78780b1110 con 0x7f78780b3fd0 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f7876ffd700 1 --2- 172.21.15.26:0/2221573004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7878159500 0x7f78781598d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78680098e0 tx=0x7f78680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451f8e39a0e7d69f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f7875ffb700 1 -- 172.21.15.26:0/2221573004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868009e80 con 0x7f7878159500 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f7875ffb700 1 -- 172.21.15.26:0/2221573004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786800b820 con 0x7f7878159500 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.149+0000 7f7875ffb700 1 -- 172.21.15.26:0/2221573004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800bba0 con 0x7f7878159500 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.150+0000 7f787d5c4700 1 -- 172.21.15.26:0/2221573004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7878159500 msgr2=0x7f78781598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.150+0000 7f787d5c4700 1 --2- 172.21.15.26:0/2221573004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7878159500 0x7f78781598d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78680098e0 tx=0x7f78680091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.150+0000 7f787d5c4700 1 -- 172.21.15.26:0/2221573004 shutdown_connections 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.150+0000 7f787d5c4700 1 --2- 172.21.15.26:0/2221573004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7878159500 0x7f78781598d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.150+0000 7f787d5c4700 1 -- 172.21.15.26:0/2221573004 >> 172.21.15.26:0/2221573004 conn(0x7f7878067630 msgr2=0x7f7878069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.150+0000 7f787d5c4700 1 -- 172.21.15.26:0/2221573004 shutdown_connections 2023-09-28T00:15:22.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.150+0000 7f787d5c4700 1 -- 172.21.15.26:0/2221573004 wait complete. 2023-09-28T00:15:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.151+0000 7f787d5c4700 1 Processor -- start 2023-09-28T00:15:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.151+0000 7f787d5c4700 1 -- start start 2023-09-28T00:15:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f787d5c4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78780b3fd0 0x7f787814c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f787d5c4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7878159500 0x7f7878169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f787d5c4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f787815dab0 0x7f787814e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:22.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f787d5c4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787816b040 con 0x7f78780b3fd0 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f787d5c4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787816a430 con 0x7f7878159500 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f787d5c4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787816a710 con 0x7f787815dab0 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f7876ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78780b3fd0 0x7f787814c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f7876ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78780b3fd0 0x7f787814c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43058/0 (socket says 172.21.15.26:43058) 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f7876ffd700 1 -- 172.21.15.26:0/3277614448 learned_addr learned my addr 172.21.15.26:0/3277614448 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f7876ffd700 1 -- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f787815dab0 msgr2=0x7f787814e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f7876ffd700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f787815dab0 0x7f787814e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f7876ffd700 1 -- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7878159500 msgr2=0x7f7878169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f7876ffd700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7878159500 0x7f7878169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f7876ffd700 1 -- 172.21.15.26:0/3277614448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868009420 con 0x7f78780b3fd0 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f7876ffd700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78780b3fd0 0x7f787814c390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78680030c0 tx=0x7f7868016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.152+0000 7f785effd700 1 -- 172.21.15.26:0/3277614448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800ba10 con 0x7f78780b3fd0 2023-09-28T00:15:22.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.153+0000 7f785effd700 1 -- 172.21.15.26:0/3277614448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7868020070 con 0x7f78780b3fd0 2023-09-28T00:15:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.153+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787816a9f0 con 0x7f78780b3fd0 2023-09-28T00:15:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.153+0000 7f785effd700 1 -- 172.21.15.26:0/3277614448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786801b6a0 con 0x7f78780b3fd0 2023-09-28T00:15:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.153+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787814c8d0 con 0x7f78780b3fd0 2023-09-28T00:15:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.154+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7878064050 con 0x7f78780b3fd0 2023-09-28T00:15:22.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.154+0000 7f785effd700 1 -- 172.21.15.26:0/3277614448 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7868022030 con 0x7f78780b3fd0 2023-09-28T00:15:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.154+0000 7f785effd700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7864067330 0x7f78640697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.154+0000 7f785effd700 1 -- 172.21.15.26:0/3277614448 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7868086850 con 0x7f78780b3fd0 2023-09-28T00:15:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.154+0000 7f78767fc700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7864067330 0x7f78640697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:22.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.155+0000 7f78767fc700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7864067330 0x7f78640697e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f786c0011e0 tx=0x7f786c0079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:22.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.159+0000 7f785effd700 1 -- 172.21.15.26:0/3277614448 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f7868053b60 con 0x7f78780b3fd0 2023-09-28T00:15:22.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.350+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f7878064050 con 0x7f78780b3fd0 2023-09-28T00:15:22.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.937+0000 7f785effd700 1 -- 172.21.15.26:0/3277614448 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f7868057180 con 0x7f78780b3fd0 2023-09-28T00:15:22.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7864067330 msgr2=0x7f78640697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:22.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7864067330 0x7f78640697e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f786c0011e0 tx=0x7f786c0079d0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78780b3fd0 msgr2=0x7f787814c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:22.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78780b3fd0 0x7f787814c390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78680030c0 tx=0x7f7868016000 comp rx=0 tx=0).stop 2023-09-28T00:15:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 shutdown_connections 2023-09-28T00:15:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7864067330 0x7f78640697e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f787815dab0 0x7f787814e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f78780b3fd0 0x7f787814c390 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 --2- 172.21.15.26:0/3277614448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7878159500 0x7f7878169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 >> 172.21.15.26:0/3277614448 conn(0x7f7878067630 msgr2=0x7f78780cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 shutdown_connections 2023-09-28T00:15:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:22.940+0000 7f787d5c4700 1 -- 172.21.15.26:0/3277614448 wait complete. 2023-09-28T00:15:22.942 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'rbd' created 2023-09-28T00:15:22.957 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-28T00:15:23.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.084+0000 7f4f7a152700 1 Processor -- start 2023-09-28T00:15:23.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.084+0000 7f4f7a152700 1 -- start start 2023-09-28T00:15:23.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.085+0000 7f4f7a152700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4f740cf810 0x7f4f740cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:23.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.085+0000 7f4f7a152700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740cbb00 0x7f4f74158e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:23.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.085+0000 7f4f7a152700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f740cb670 con 0x7f4f740cf440 2023-09-28T00:15:23.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.085+0000 7f4f7a152700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f740cbf30 con 0x7f4f740cf810 2023-09-28T00:15:23.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.085+0000 7f4f7a152700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f740cce90 con 0x7f4f740cbb00 2023-09-28T00:15:23.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.085+0000 7f4f79150700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4f740cf440 0x7f4f740cc140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47898/0 (socket says 172.21.15.26:47898) 2023-09-28T00:15:23.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.085+0000 7f4f79150700 1 -- 172.21.15.26:0/1694250494 learned_addr learned my addr 172.21.15.26:0/1694250494 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:23.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.085+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370567390 0 0) 0x7f4f740cb670 con 0x7f4f740cf440 2023-09-28T00:15:23.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f5c003570 con 0x7f4f740cf440 2023-09-28T00:15:23.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79951700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740cbb00 0x7f4f74158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:23.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f7894f700 1 --2- 172.21.15.26:0/1694250494 >> v2:172.21.15.190:3300/0 conn(0x7f4f740cf810 0x7f4f740cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:23.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1319685013 0 0) 0x7f4f5c003570 con 0x7f4f740cf440 2023-09-28T00:15:23.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740cbb00 msgr2=0x7f4f74158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:23.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740cbb00 0x7f4f74158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 >> v2:172.21.15.190:3300/0 conn(0x7f4f740cf810 msgr2=0x7f4f740cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:23.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 --2- 172.21.15.26:0/1694250494 >> v2:172.21.15.190:3300/0 conn(0x7f4f740cf810 0x7f4f740cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f740cad80 con 0x7f4f740cf440 2023-09-28T00:15:23.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7f4f640017f0 con 0x7f4f740cf440 2023-09-28T00:15:23.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 >> v1:172.21.15.26:6789/0 conn(0x7f4f740cf440 legacy=0x7f4f740cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:23.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740cbb00 0x7f4f5c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:23.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c003fe0 0x7f4f5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:23.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5c004d50 0x7f4f5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:23.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f740cbf30 con 0x7f4f5c004d50 2023-09-28T00:15:23.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f740cce90 con 0x7f4f5c003fe0 2023-09-28T00:15:23.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5c00ba90 con 0x7f4f740cbb00 2023-09-28T00:15:23.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79951700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5c004d50 0x7f4f5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:23.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79150700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740cbb00 0x7f4f5c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:23.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f7894f700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c003fe0 0x7f4f5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:23.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79951700 1 -- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740cbb00 msgr2=0x7f4f5c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:23.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79951700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740cbb00 0x7f4f5c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79951700 1 -- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c003fe0 msgr2=0x7f4f5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:23.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79951700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f5c003fe0 0x7f4f5c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79951700 1 -- 172.21.15.26:0/1694250494 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5c003570 con 0x7f4f5c004d50 2023-09-28T00:15:23.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79150700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740cbb00 0x7f4f5c003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:23.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.086+0000 7f4f79951700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5c004d50 0x7f4f5c0051c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009c00 tx=0x7f4f6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe99f870e2a77af5 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:23.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00e6b0 con 0x7f4f5c004d50 2023-09-28T00:15:23.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c00e810 con 0x7f4f5c004d50 2023-09-28T00:15:23.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f73fff700 1 -- 172.21.15.26:0/1694250494 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00ebd0 con 0x7f4f5c004d50 2023-09-28T00:15:23.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f7a152700 1 -- 172.21.15.26:0/1694250494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5c004d50 msgr2=0x7f4f5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:23.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f7a152700 1 --2- 172.21.15.26:0/1694250494 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f5c004d50 0x7f4f5c0051c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009c00 tx=0x7f4f6c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f79951700 1 -- 172.21.15.26:0/1694250494 reap_dead start 2023-09-28T00:15:23.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f7a152700 1 -- 172.21.15.26:0/1694250494 shutdown_connections 2023-09-28T00:15:23.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f7a152700 1 -- 172.21.15.26:0/1694250494 >> 172.21.15.26:0/1694250494 conn(0x7f4f740cd080 msgr2=0x7f4f740cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:23.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f7a152700 1 -- 172.21.15.26:0/1694250494 shutdown_connections 2023-09-28T00:15:23.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.087+0000 7f4f7a152700 1 -- 172.21.15.26:0/1694250494 wait complete. 2023-09-28T00:15:23.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.088+0000 7f4f7a152700 1 Processor -- start 2023-09-28T00:15:23.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.088+0000 7f4f7a152700 1 -- start start 2023-09-28T00:15:23.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.089+0000 7f4f7a152700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f741461a0 0x7f4f740c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:23.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.089+0000 7f4f7a152700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740ca760 0x7f4f7415df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:23.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.089+0000 7f4f7a152700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7415e4a0 0x7f4f74159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:23.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.089+0000 7f4f7a152700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f740c99d0 con 0x7f4f7415e4a0 2023-09-28T00:15:23.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.089+0000 7f4f7a152700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7415d480 con 0x7f4f741461a0 2023-09-28T00:15:23.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.089+0000 7f4f7a152700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7415d760 con 0x7f4f740ca760 2023-09-28T00:15:23.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.089+0000 7f4f79951700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7415e4a0 0x7f4f74159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:23.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.089+0000 7f4f79951700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7415e4a0 0x7f4f74159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43068/0 (socket says 172.21.15.26:43068) 2023-09-28T00:15:23.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.089+0000 7f4f79951700 1 -- 172.21.15.26:0/2284674304 learned_addr learned my addr 172.21.15.26:0/2284674304 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:23.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f7894f700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740ca760 0x7f4f7415df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:23.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f79150700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f741461a0 0x7f4f740c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:23.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f79951700 1 -- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740ca760 msgr2=0x7f4f7415df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:23.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f79951700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740ca760 0x7f4f7415df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f79951700 1 -- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f741461a0 msgr2=0x7f4f740c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:23.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f79951700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f741461a0 0x7f4f740c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f79951700 1 -- 172.21.15.26:0/2284674304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7415da40 con 0x7f4f7415e4a0 2023-09-28T00:15:23.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f79150700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f741461a0 0x7f4f740c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:23.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f79951700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7415e4a0 0x7f4f74159f40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c001eb0 tx=0x7f4f6c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:23.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f717fa700 1 -- 172.21.15.26:0/2284674304 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c022070 con 0x7f4f7415e4a0 2023-09-28T00:15:23.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f717fa700 1 -- 172.21.15.26:0/2284674304 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6c00eb90 con 0x7f4f7415e4a0 2023-09-28T00:15:23.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7415d130 con 0x7f4f7415e4a0 2023-09-28T00:15:23.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f717fa700 1 -- 172.21.15.26:0/2284674304 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00e6b0 con 0x7f4f7415e4a0 2023-09-28T00:15:23.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.090+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f74146570 con 0x7f4f7415e4a0 2023-09-28T00:15:23.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.091+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f740633f0 con 0x7f4f7415e4a0 2023-09-28T00:15:23.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.092+0000 7f4f717fa700 1 -- 172.21.15.26:0/2284674304 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4f6c01c8d0 con 0x7f4f7415e4a0 2023-09-28T00:15:23.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.092+0000 7f4f717fa700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4f60067330 0x7f4f600697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:23.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.092+0000 7f4f717fa700 1 -- 172.21.15.26:0/2284674304 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f4f6c000e40 con 0x7f4f7415e4a0 2023-09-28T00:15:23.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.092+0000 7f4f79150700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4f60067330 0x7f4f600697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:23.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.093+0000 7f4f79150700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4f60067330 0x7f4f600697e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400a430 tx=0x7f4f64006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:23.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.097+0000 7f4f717fa700 1 -- 172.21.15.26:0/2284674304 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4f6c053290 con 0x7f4f7415e4a0 2023-09-28T00:15:23.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.291+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4f74064050 con 0x7f4f7415e4a0 2023-09-28T00:15:23.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.942+0000 7f4f717fa700 1 -- 172.21.15.26:0/2284674304 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f4f6c0568b0 con 0x7f4f7415e4a0 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.945+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4f60067330 msgr2=0x7f4f600697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.945+0000 7f4f7a152700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4f60067330 0x7f4f600697e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4f6400a430 tx=0x7f4f64006040 comp rx=0 tx=0).stop 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.945+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7415e4a0 msgr2=0x7f4f74159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.945+0000 7f4f7a152700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7415e4a0 0x7f4f74159f40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c001eb0 tx=0x7f4f6c01a000 comp rx=0 tx=0).stop 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.946+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 shutdown_connections 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.946+0000 7f4f7a152700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4f60067330 0x7f4f600697e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.946+0000 7f4f7a152700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4f7415e4a0 0x7f4f74159f40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.946+0000 7f4f7a152700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4f741461a0 0x7f4f740c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.946+0000 7f4f7a152700 1 --2- 172.21.15.26:0/2284674304 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4f740ca760 0x7f4f7415df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:23.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.946+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 >> 172.21.15.26:0/2284674304 conn(0x7f4f740cd080 msgr2=0x7f4f74068810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.946+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 shutdown_connections 2023-09-28T00:15:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:23.946+0000 7f4f7a152700 1 -- 172.21.15.26:0/2284674304 wait complete. 2023-09-28T00:15:23.948 INFO:teuthology.orchestra.run.smithi026.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-28T00:15:23.961 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-28T00:15:23.962 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-28T00:15:23.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-28T00:15:23.964 INFO:tasks.ceph.mds.a:Started 2023-09-28T00:15:23.964 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-28T00:15:23.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-28T00:15:23.966 INFO:tasks.ceph.mds.c:Started 2023-09-28T00:15:23.966 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-28T00:15:23.967 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-28T00:15:23.969 INFO:tasks.ceph.mds.b:Started 2023-09-28T00:15:23.969 INFO:tasks.ceph.mds.d:Restarting daemon 2023-09-28T00:15:23.969 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-09-28T00:15:23.971 INFO:tasks.ceph.mds.d:Started 2023-09-28T00:15:23.972 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-28T00:15:23.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:24.045 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2023-09-28T00:15:24.046 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2023-09-28T00:15:24.049 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2023-09-28T00:15:24.050 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-09-28T00:15:24.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.101+0000 7f2ec727c700 1 Processor -- start 2023-09-28T00:15:24.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.101+0000 7f2ec727c700 1 -- start start 2023-09-28T00:15:24.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec727c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2ec015d560 0x7f2ec00d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec727c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ec01591b0 0x7f2ec0159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec727c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec00b2ad0 con 0x7f2ec015d930 2023-09-28T00:15:24.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec727c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec00b4160 con 0x7f2ec01591b0 2023-09-28T00:15:24.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec727c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec00b2230 con 0x7f2ec015d560 2023-09-28T00:15:24.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec5819700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ec01591b0 0x7f2ec0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec5819700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ec01591b0 0x7f2ec0159600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43112/0 (socket says 172.21.15.26:43112) 2023-09-28T00:15:24.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec5819700 1 -- 172.21.15.26:0/4238390632 learned_addr learned my addr 172.21.15.26:0/4238390632 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec5018700 1 --2- 172.21.15.26:0/4238390632 >> v2:172.21.15.190:3300/0 conn(0x7f2ec015d560 0x7f2ec00d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec5819700 1 -- 172.21.15.26:0/4238390632 >> v2:172.21.15.190:3300/0 conn(0x7f2ec015d560 msgr2=0x7f2ec00d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec5819700 1 --2- 172.21.15.26:0/4238390632 >> v2:172.21.15.190:3300/0 conn(0x7f2ec015d560 0x7f2ec00d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec5819700 1 -- 172.21.15.26:0/4238390632 >> v1:172.21.15.190:6789/0 conn(0x7f2ec015d930 legacy=0x7f2ec00b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec5819700 1 -- 172.21.15.26:0/4238390632 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00b2510 con 0x7f2ec01591b0 2023-09-28T00:15:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ec5819700 1 --2- 172.21.15.26:0/4238390632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 0x7f2ec0159600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0071410 tx=0x7f2eb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=736334ce9eb4adcb server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.102+0000 7f2ebffff700 1 -- 172.21.15.26:0/4238390632 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb800e070 con 0x7f2ec01591b0 2023-09-28T00:15:24.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ebffff700 1 -- 172.21.15.26:0/4238390632 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb800ba20 con 0x7f2ec01591b0 2023-09-28T00:15:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ebffff700 1 -- 172.21.15.26:0/4238390632 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb80092e0 con 0x7f2ec01591b0 2023-09-28T00:15:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ec727c700 1 -- 172.21.15.26:0/4238390632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 msgr2=0x7f2ec0159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ec727c700 1 --2- 172.21.15.26:0/4238390632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 0x7f2ec0159600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0071410 tx=0x7f2eb8009840 comp rx=0 tx=0).stop 2023-09-28T00:15:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ec727c700 1 -- 172.21.15.26:0/4238390632 shutdown_connections 2023-09-28T00:15:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ec727c700 1 --2- 172.21.15.26:0/4238390632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 0x7f2ec0159600 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ec727c700 1 --2- 172.21.15.26:0/4238390632 >> v2:172.21.15.190:3300/0 conn(0x7f2ec015d560 0x7f2ec00d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ec727c700 1 -- 172.21.15.26:0/4238390632 >> 172.21.15.26:0/4238390632 conn(0x7f2ec00d1180 msgr2=0x7f2ec0069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:24.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ec727c700 1 -- 172.21.15.26:0/4238390632 shutdown_connections 2023-09-28T00:15:24.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.103+0000 7f2ec727c700 1 -- 172.21.15.26:0/4238390632 wait complete. 2023-09-28T00:15:24.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.104+0000 7f2ec727c700 1 Processor -- start 2023-09-28T00:15:24.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.104+0000 7f2ec727c700 1 -- start start 2023-09-28T00:15:24.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec727c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 0x7f2ec014c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec727c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ec015d560 0x7f2ec014f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec727c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec015d930 0x7f2ec014f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec727c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0151be0 con 0x7f2ec01591b0 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec727c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec014c740 con 0x7f2ec015d930 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec727c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0169640 con 0x7f2ec015d560 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec5018700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 0x7f2ec014c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec5018700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 0x7f2ec014c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43116/0 (socket says 172.21.15.26:43116) 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec5018700 1 -- 172.21.15.26:0/1651655368 learned_addr learned my addr 172.21.15.26:0/1651655368 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec5819700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec015d930 0x7f2ec014f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec4817700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ec015d560 0x7f2ec014f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec5018700 1 -- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ec015d560 msgr2=0x7f2ec014f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec5018700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ec015d560 0x7f2ec014f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec5018700 1 -- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec015d930 msgr2=0x7f2ec014f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.105+0000 7f2ec5018700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec015d930 0x7f2ec014f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.106+0000 7f2ec5018700 1 -- 172.21.15.26:0/1651655368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8009ae0 con 0x7f2ec01591b0 2023-09-28T00:15:24.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.106+0000 7f2ec5819700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec015d930 0x7f2ec014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:24.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.106+0000 7f2ec5018700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 0x7f2ec014c200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000ecb0 tx=0x7f2eb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:24.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.106+0000 7f2ebd7fa700 1 -- 172.21.15.26:0/1651655368 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000c9d0 con 0x7f2ec01591b0 2023-09-28T00:15:24.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.106+0000 7f2ebd7fa700 1 -- 172.21.15.26:0/1651655368 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb000cb30 con 0x7f2ec01591b0 2023-09-28T00:15:24.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.106+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec0151e30 con 0x7f2ec01591b0 2023-09-28T00:15:24.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.106+0000 7f2ebd7fa700 1 -- 172.21.15.26:0/1651655368 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000ced0 con 0x7f2ec01591b0 2023-09-28T00:15:24.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.106+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec01523f0 con 0x7f2ec01591b0 2023-09-28T00:15:24.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.107+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec01699a0 con 0x7f2ec01591b0 2023-09-28T00:15:24.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.107+0000 7f2ebd7fa700 1 -- 172.21.15.26:0/1651655368 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2eb0013680 con 0x7f2ec01591b0 2023-09-28T00:15:24.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.108+0000 7f2ebd7fa700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2eac067330 0x7f2eac0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.108+0000 7f2ebd7fa700 1 -- 172.21.15.26:0/1651655368 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2eb0084c20 con 0x7f2ec01591b0 2023-09-28T00:15:24.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.108+0000 7f2ec4817700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2eac067330 0x7f2eac0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.108+0000 7f2ec4817700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2eac067330 0x7f2eac0697e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0150af0 tx=0x7f2eb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:24.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.112+0000 7f2ebd7fa700 1 -- 172.21.15.26:0/1651655368 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2eb0051e70 con 0x7f2ec01591b0 2023-09-28T00:15:24.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.308+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ec0064050 con 0x7f2ec01591b0 2023-09-28T00:15:24.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.309+0000 7f2ebd7fa700 1 -- 172.21.15.26:0/1651655368 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13660 (secure 0 0 0) 0x7f2eb0017090 con 0x7f2ec01591b0 2023-09-28T00:15:24.310 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:24.310 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:23.937307+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2eac067330 msgr2=0x7f2eac0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2eac067330 0x7f2eac0697e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0150af0 tx=0x7f2eb4009040 comp rx=0 tx=0).stop 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 msgr2=0x7f2ec014c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 0x7f2ec014c200 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000ecb0 tx=0x7f2eb00091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 shutdown_connections 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2eac067330 0x7f2eac0697e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2ec015d930 0x7f2ec014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec01591b0 0x7f2ec014c200 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 --2- 172.21.15.26:0/1651655368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2ec015d560 0x7f2ec014f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 >> 172.21.15.26:0/1651655368 conn(0x7f2ec00d1180 msgr2=0x7f2ec0067cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:24.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 shutdown_connections 2023-09-28T00:15:24.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.311+0000 7f2ec727c700 1 -- 172.21.15.26:0/1651655368 wait complete. 2023-09-28T00:15:24.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T00:15:15.721561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T00:15:22.381112+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-28T00:15:24.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T00:15:24.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.445+0000 7ff9693ab700 1 Processor -- start 2023-09-28T00:15:24.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.445+0000 7ff9693ab700 1 -- start start 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff9693ab700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff96415d510 0x7ff9640b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff9693ab700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 0x7ff9640b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff9693ab700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9640b3870 con 0x7ff964069000 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff9693ab700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9640694e0 con 0x7ff96415d510 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff9693ab700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9640697c0 con 0x7ff964159860 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff963fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff96415d510 0x7ff9640b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff9637fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff964069000 0x7ff964159150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47910/0 (socket says 172.21.15.26:47910) 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff9637fe700 1 -- 172.21.15.26:0/3255610948 learned_addr learned my addr 172.21.15.26:0/3255610948 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff968baa700 1 --2- 172.21.15.26:0/3255610948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 0x7ff9640b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff963fff700 1 -- 172.21.15.26:0/3255610948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 msgr2=0x7ff9640b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:24.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff963fff700 1 --2- 172.21.15.26:0/3255610948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 0x7ff9640b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff963fff700 1 -- 172.21.15.26:0/3255610948 >> v1:172.21.15.26:6789/0 conn(0x7ff964069000 legacy=0x7ff964159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff962ffd700 1 -- 172.21.15.26:0/3255610948 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447366711 0 0) 0x7ff9640b3870 con 0x7ff964069000 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff963fff700 1 -- 172.21.15.26:0/3255610948 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964069aa0 con 0x7ff96415d510 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.446+0000 7ff963fff700 1 --2- 172.21.15.26:0/3255610948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96415d510 0x7ff9640b3330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0098e0 tx=0x7ff94c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe00826baee6090 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff962ffd700 1 -- 172.21.15.26:0/3255610948 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00b640 con 0x7ff96415d510 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff962ffd700 1 -- 172.21.15.26:0/3255610948 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c00b7a0 con 0x7ff96415d510 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff962ffd700 1 -- 172.21.15.26:0/3255610948 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00bb40 con 0x7ff96415d510 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff9693ab700 1 -- 172.21.15.26:0/3255610948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96415d510 msgr2=0x7ff9640b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff9693ab700 1 --2- 172.21.15.26:0/3255610948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96415d510 0x7ff9640b3330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0098e0 tx=0x7ff94c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff9693ab700 1 -- 172.21.15.26:0/3255610948 shutdown_connections 2023-09-28T00:15:24.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff9693ab700 1 --2- 172.21.15.26:0/3255610948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 0x7ff9640b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff9693ab700 1 --2- 172.21.15.26:0/3255610948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff96415d510 0x7ff9640b3330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff9693ab700 1 -- 172.21.15.26:0/3255610948 >> 172.21.15.26:0/3255610948 conn(0x7ff9640ccfa0 msgr2=0x7ff9640cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:24.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff9693ab700 1 -- 172.21.15.26:0/3255610948 shutdown_connections 2023-09-28T00:15:24.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.447+0000 7ff9693ab700 1 -- 172.21.15.26:0/3255610948 wait complete. 2023-09-28T00:15:24.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.448+0000 7ff9693ab700 1 Processor -- start 2023-09-28T00:15:24.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.448+0000 7ff9693ab700 1 -- start start 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff9693ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff964069000 0x7ff9641557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff9693ab700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 0x7ff9640c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff9693ab700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96415d510 0x7ff9640c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff9693ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9640cc0e0 con 0x7ff964069000 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff9693ab700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff964169be0 con 0x7ff96415d510 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff9693ab700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff964169ec0 con 0x7ff964159860 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff963fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff964069000 0x7ff9641557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff963fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff964069000 0x7ff9641557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43130/0 (socket says 172.21.15.26:43130) 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff963fff700 1 -- 172.21.15.26:0/2610335984 learned_addr learned my addr 172.21.15.26:0/2610335984 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:24.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff9637fe700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 0x7ff9640c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.449+0000 7ff968baa700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96415d510 0x7ff9640c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff963fff700 1 -- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 msgr2=0x7ff9640c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff963fff700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 0x7ff9640c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff963fff700 1 -- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96415d510 msgr2=0x7ff9640c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff963fff700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96415d510 0x7ff9640c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff963fff700 1 -- 172.21.15.26:0/2610335984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009420 con 0x7ff964069000 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff968baa700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96415d510 0x7ff9640c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff963fff700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff964069000 0x7ff9641557d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009f80 tx=0x7ff94c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff95bfff700 1 -- 172.21.15.26:0/2610335984 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00bb20 con 0x7ff964069000 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff964156220 con 0x7ff964069000 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9641567e0 con 0x7ff964069000 2023-09-28T00:15:24.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff95bfff700 1 -- 172.21.15.26:0/2610335984 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c011630 con 0x7ff964069000 2023-09-28T00:15:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.450+0000 7ff95bfff700 1 -- 172.21.15.26:0/2610335984 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c0117a0 con 0x7ff964069000 2023-09-28T00:15:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.451+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9640b0060 con 0x7ff964069000 2023-09-28T00:15:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.451+0000 7ff95bfff700 1 -- 172.21.15.26:0/2610335984 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff94c011b10 con 0x7ff964069000 2023-09-28T00:15:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.452+0000 7ff95bfff700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff944067330 0x7ff9440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.452+0000 7ff95bfff700 1 -- 172.21.15.26:0/2610335984 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff94c085e50 con 0x7ff964069000 2023-09-28T00:15:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.452+0000 7ff9637fe700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff944067330 0x7ff9440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.452+0000 7ff9637fe700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff944067330 0x7ff9440697e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9640cdb50 tx=0x7ff954009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:24.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.456+0000 7ff95bfff700 1 -- 172.21.15.26:0/2610335984 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff94c0530a0 con 0x7ff964069000 2023-09-28T00:15:24.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.647+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff96404c3c0 con 0x7ff964069000 2023-09-28T00:15:24.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.648+0000 7ff95bfff700 1 -- 172.21.15.26:0/2610335984 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff94c0566c0 con 0x7ff964069000 2023-09-28T00:15:24.649 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-09-28T00:15:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff944067330 msgr2=0x7ff9440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff944067330 0x7ff9440697e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff9640cdb50 tx=0x7ff954009040 comp rx=0 tx=0).stop 2023-09-28T00:15:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff964069000 msgr2=0x7ff9641557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff964069000 0x7ff9641557d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009f80 tx=0x7ff94c017000 comp rx=0 tx=0).stop 2023-09-28T00:15:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 shutdown_connections 2023-09-28T00:15:24.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff944067330 0x7ff9440697e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff96415d510 0x7ff9640c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff964069000 0x7ff9641557d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 --2- 172.21.15.26:0/2610335984 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff964159860 0x7ff9640c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 >> 172.21.15.26:0/2610335984 conn(0x7ff9640ccfa0 msgr2=0x7ff9640b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 shutdown_connections 2023-09-28T00:15:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.650+0000 7ff9693ab700 1 -- 172.21.15.26:0/2610335984 wait complete. 2023-09-28T00:15:24.663 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T00:15:24.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.783+0000 7f449c393700 1 Processor -- start 2023-09-28T00:15:24.785 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.783+0000 7f449c393700 1 -- start start 2023-09-28T00:15:24.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.784+0000 7f449c393700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44940cc090 0x7f4494158750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.784+0000 7f449c393700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44941582c0 con 0x7f44941553f0 2023-09-28T00:15:24.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.784+0000 7f449c393700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4494157fc0 con 0x7f4494068ed0 2023-09-28T00:15:24.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.784+0000 7f449c393700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940af520 con 0x7f44940cc090 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449992e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44940cc090 0x7f4494158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449a12f700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f44941553f0 0x7f449415b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47920/0 (socket says 172.21.15.26:47920) 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449a12f700 1 -- 172.21.15.26:0/771108990 learned_addr learned my addr 172.21.15.26:0/771108990 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449992e700 1 -- 172.21.15.26:0/771108990 >> v1:172.21.15.190:6789/0 conn(0x7f4494068ed0 legacy=0x7f44940ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449992e700 1 -- 172.21.15.26:0/771108990 >> v1:172.21.15.26:6789/0 conn(0x7f44941553f0 legacy=0x7f449415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449992e700 1 -- 172.21.15.26:0/771108990 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449415bd00 con 0x7f44940cc090 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449992e700 1 --2- 172.21.15.26:0/771108990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44940cc090 0x7f4494158750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f44880098e0 tx=0x7f44880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7315d707f15afe9b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449912d700 1 -- 172.21.15.26:0/771108990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488009e80 con 0x7f44940cc090 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449912d700 1 -- 172.21.15.26:0/771108990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448800b820 con 0x7f44940cc090 2023-09-28T00:15:24.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.785+0000 7f449912d700 1 -- 172.21.15.26:0/771108990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800bba0 con 0x7f44940cc090 2023-09-28T00:15:24.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.786+0000 7f449c393700 1 -- 172.21.15.26:0/771108990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44940cc090 msgr2=0x7f4494158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.786+0000 7f449c393700 1 --2- 172.21.15.26:0/771108990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44940cc090 0x7f4494158750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f44880098e0 tx=0x7f44880091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.786+0000 7f449c393700 1 -- 172.21.15.26:0/771108990 shutdown_connections 2023-09-28T00:15:24.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.786+0000 7f449c393700 1 --2- 172.21.15.26:0/771108990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44940cc090 0x7f4494158750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.786+0000 7f449c393700 1 -- 172.21.15.26:0/771108990 >> 172.21.15.26:0/771108990 conn(0x7f449406e910 msgr2=0x7f449406be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.786+0000 7f449c393700 1 -- 172.21.15.26:0/771108990 shutdown_connections 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.786+0000 7f449c393700 1 -- 172.21.15.26:0/771108990 wait complete. 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.787+0000 7f449c393700 1 Processor -- start 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.787+0000 7f449c393700 1 -- start start 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449c393700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4494068ed0 0x7f44940aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449c393700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44940cc090 0x7f4494159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449c393700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44941553f0 0x7f4494159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449c393700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940a54c0 con 0x7f44941553f0 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449c393700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940a62e0 con 0x7f44940cc090 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449c393700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940a56d0 con 0x7f4494068ed0 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a930700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44941553f0 0x7f4494159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a930700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44941553f0 0x7f4494159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43152/0 (socket says 172.21.15.26:43152) 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a930700 1 -- 172.21.15.26:0/2176619574 learned_addr learned my addr 172.21.15.26:0/2176619574 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a12f700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4494068ed0 0x7f44940aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449992e700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44940cc090 0x7f4494159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a930700 1 -- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4494068ed0 msgr2=0x7f44940aab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a930700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4494068ed0 0x7f44940aab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a930700 1 -- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44940cc090 msgr2=0x7f4494159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a930700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44940cc090 0x7f4494159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a930700 1 -- 172.21.15.26:0/2176619574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488009420 con 0x7f44941553f0 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449a930700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44941553f0 0x7f4494159c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f448c00b4e0 tx=0x7f448c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f44927fc700 1 -- 172.21.15.26:0/2176619574 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00f5e0 con 0x7f44941553f0 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f44927fc700 1 -- 172.21.15.26:0/2176619574 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c00f740 con 0x7f44941553f0 2023-09-28T00:15:24.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f44927fc700 1 -- 172.21.15.26:0/2176619574 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00fb00 con 0x7f44941553f0 2023-09-28T00:15:24.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940a59b0 con 0x7f44941553f0 2023-09-28T00:15:24.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.788+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940a5f70 con 0x7f44941553f0 2023-09-28T00:15:24.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.789+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940a6470 con 0x7f44941553f0 2023-09-28T00:15:24.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.790+0000 7f44927fc700 1 -- 172.21.15.26:0/2176619574 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f448c01a400 con 0x7f44941553f0 2023-09-28T00:15:24.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.790+0000 7f44927fc700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4480067330 0x7f44800697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:24.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.790+0000 7f44927fc700 1 -- 172.21.15.26:0/2176619574 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f448c084460 con 0x7f44941553f0 2023-09-28T00:15:24.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.790+0000 7f449a12f700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4480067330 0x7f44800697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:24.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.791+0000 7f449a12f700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4480067330 0x7f44800697e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f448400e160 tx=0x7f4484009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:24.795 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.794+0000 7f44927fc700 1 -- 172.21.15.26:0/2176619574 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f448c051730 con 0x7f44941553f0 2023-09-28T00:15:24.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.985+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4494064050 con 0x7f44941553f0 2023-09-28T00:15:24.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.986+0000 7f44927fc700 1 -- 172.21.15.26:0/2176619574 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f448c054d50 con 0x7f44941553f0 2023-09-28T00:15:24.987 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-09-28T00:15:24.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4480067330 msgr2=0x7f44800697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4480067330 0x7f44800697e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f448400e160 tx=0x7f4484009040 comp rx=0 tx=0).stop 2023-09-28T00:15:24.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44941553f0 msgr2=0x7f4494159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:24.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44941553f0 0x7f4494159c60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f448c00b4e0 tx=0x7f448c006f90 comp rx=0 tx=0).stop 2023-09-28T00:15:24.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 shutdown_connections 2023-09-28T00:15:24.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4480067330 0x7f44800697e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4494068ed0 0x7f44940aab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44941553f0 0x7f4494159c60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 --2- 172.21.15.26:0/2176619574 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f44940cc090 0x7f4494159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 >> 172.21.15.26:0/2176619574 conn(0x7f449406e910 msgr2=0x7f44940ab730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 shutdown_connections 2023-09-28T00:15:24.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:24.988+0000 7f449c393700 1 -- 172.21.15.26:0/2176619574 wait complete. 2023-09-28T00:15:25.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:15:25.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.121+0000 7fb4fd2e4700 1 Processor -- start 2023-09-28T00:15:25.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.121+0000 7fb4fd2e4700 1 -- start start 2023-09-28T00:15:25.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4fd2e4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb4f8156240 0x7fb4f80b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4fd2e4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8157620 0x7fb4f80b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4fd2e4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f80b0ac0 con 0x7fb4f80b0f50 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4fd2e4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f815ae50 con 0x7fb4f8156240 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4fd2e4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f80b0190 con 0x7fb4f8157620 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4f6ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb4f8156240 0x7fb4f80b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4f67fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb4f80b0f50 0x7fb4f815a090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47924/0 (socket says 172.21.15.26:47924) 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4f67fc700 1 -- 172.21.15.26:0/3960692850 learned_addr learned my addr 172.21.15.26:0/3960692850 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4f77fe700 1 --2- 172.21.15.26:0/3960692850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8157620 0x7fb4f80b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4f6ffd700 1 -- 172.21.15.26:0/3960692850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8157620 msgr2=0x7fb4f80b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4f6ffd700 1 --2- 172.21.15.26:0/3960692850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8157620 0x7fb4f80b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4f6ffd700 1 -- 172.21.15.26:0/3960692850 >> v1:172.21.15.26:6789/0 conn(0x7fb4f80b0f50 legacy=0x7fb4f815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4f6ffd700 1 -- 172.21.15.26:0/3960692850 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f80b0470 con 0x7fb4f8156240 2023-09-28T00:15:25.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.122+0000 7fb4f77fe700 1 --2- 172.21.15.26:0/3960692850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8157620 0x7fb4f80b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4f6ffd700 1 --2- 172.21.15.26:0/3960692850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8156240 0x7fb4f80b1660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800bb90 tx=0x7fb4e800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a264f7f49c1a63e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3960692850 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e800dba0 con 0x7fb4f8156240 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3960692850 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e800dd00 con 0x7fb4f8156240 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4f5ffb700 1 -- 172.21.15.26:0/3960692850 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80196b0 con 0x7fb4f8156240 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/3960692850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8156240 msgr2=0x7fb4f80b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4fd2e4700 1 --2- 172.21.15.26:0/3960692850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8156240 0x7fb4f80b1660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb4e800bb90 tx=0x7fb4e800b430 comp rx=0 tx=0).stop 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/3960692850 shutdown_connections 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4fd2e4700 1 --2- 172.21.15.26:0/3960692850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8157620 0x7fb4f80b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4fd2e4700 1 --2- 172.21.15.26:0/3960692850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8156240 0x7fb4f80b1660 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/3960692850 >> 172.21.15.26:0/3960692850 conn(0x7fb4f806e6f0 msgr2=0x7fb4f806afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/3960692850 shutdown_connections 2023-09-28T00:15:25.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.123+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/3960692850 wait complete. 2023-09-28T00:15:25.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4fd2e4700 1 Processor -- start 2023-09-28T00:15:25.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4fd2e4700 1 -- start start 2023-09-28T00:15:25.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4fd2e4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f80b0f50 0x7fb4f8168a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4fd2e4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8156240 0x7fb4f80cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4fd2e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8157620 0x7fb4f80cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4fd2e4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8168f70 con 0x7fb4f8157620 2023-09-28T00:15:25.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4fd2e4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8149280 con 0x7fb4f80b0f50 2023-09-28T00:15:25.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4fd2e4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8148670 con 0x7fb4f8156240 2023-09-28T00:15:25.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4f77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8157620 0x7fb4f80cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4f77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8157620 0x7fb4f80cc460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43166/0 (socket says 172.21.15.26:43166) 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.125+0000 7fb4f77fe700 1 -- 172.21.15.26:0/1862075905 learned_addr learned my addr 172.21.15.26:0/1862075905 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4f67fc700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8156240 0x7fb4f80cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4f6ffd700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f80b0f50 0x7fb4f8168a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4f77fe700 1 -- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8156240 msgr2=0x7fb4f80cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4f77fe700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8156240 0x7fb4f80cbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4f77fe700 1 -- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f80b0f50 msgr2=0x7fb4f8168a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4f77fe700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f80b0f50 0x7fb4f8168a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4f77fe700 1 -- 172.21.15.26:0/1862075905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e800b6d0 con 0x7fb4f8157620 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4f77fe700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8157620 0x7fb4f80cc460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009fc0 tx=0x7fb4f00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:25.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4deffd700 1 -- 172.21.15.26:0/1862075905 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000dd40 con 0x7fb4f8157620 2023-09-28T00:15:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4deffd700 1 -- 172.21.15.26:0/1862075905 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f000f040 con 0x7fb4f8157620 2023-09-28T00:15:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f8148950 con 0x7fb4f8157620 2023-09-28T00:15:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4deffd700 1 -- 172.21.15.26:0/1862075905 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0015690 con 0x7fb4f8157620 2023-09-28T00:15:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.126+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f8148f10 con 0x7fb4f8157620 2023-09-28T00:15:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.127+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f8064050 con 0x7fb4f8157620 2023-09-28T00:15:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.127+0000 7fb4deffd700 1 -- 172.21.15.26:0/1862075905 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb4f001e3b0 con 0x7fb4f8157620 2023-09-28T00:15:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.128+0000 7fb4deffd700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb4e4067330 0x7fb4e40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.128+0000 7fb4deffd700 1 -- 172.21.15.26:0/1862075905 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb4f0084db0 con 0x7fb4f8157620 2023-09-28T00:15:25.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.128+0000 7fb4f6ffd700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb4e4067330 0x7fb4e40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.129+0000 7fb4f6ffd700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb4e4067330 0x7fb4e40697e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4f815aaa0 tx=0x7fb4e801b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:25.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.132+0000 7fb4deffd700 1 -- 172.21.15.26:0/1862075905 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb4f0052000 con 0x7fb4f8157620 2023-09-28T00:15:25.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.367+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4f80b0750 con 0x7fb4f8157620 2023-09-28T00:15:25.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.367+0000 7fb4deffd700 1 -- 172.21.15.26:0/1862075905 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7fb4f001ade0 con 0x7fb4f8157620 2023-09-28T00:15:25.368 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:25.368 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1101672577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1101672577},{"type":"v1","addr":"172.21.15.190:6836","nonce":1101672577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3243251915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3243251915},{"type":"v1","addr":"172.21.15.26:6834","nonce":3243251915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/501056069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":501056069},{"type":"v1","addr":"172.21.15.26:6835","nonce":501056069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/3098279304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3098279304},{"type":"v1","addr":"172.21.15.190:6837","nonce":3098279304}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-09-28T00:15:25.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb4e4067330 msgr2=0x7fb4e40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb4e4067330 0x7fb4e40697e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4f815aaa0 tx=0x7fb4e801b000 comp rx=0 tx=0).stop 2023-09-28T00:15:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8157620 msgr2=0x7fb4f80cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8157620 0x7fb4f80cc460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009fc0 tx=0x7fb4f00099b0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 shutdown_connections 2023-09-28T00:15:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb4e4067330 0x7fb4e40697e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb4f8157620 0x7fb4f80cc460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb4f80b0f50 0x7fb4f8168a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 --2- 172.21.15.26:0/1862075905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb4f8156240 0x7fb4f80cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 >> 172.21.15.26:0/1862075905 conn(0x7fb4f806e6f0 msgr2=0x7fb4f8150fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:25.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 shutdown_connections 2023-09-28T00:15:25.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.369+0000 7fb4fd2e4700 1 -- 172.21.15.26:0/1862075905 wait complete. 2023-09-28T00:15:25.372 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 3 2023-09-28T00:15:25.383 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.500+0000 7f2c63fe1700 1 Processor -- start 2023-09-28T00:15:25.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.500+0000 7f2c63fe1700 1 -- start start 2023-09-28T00:15:25.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c63fe1700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2c5c15d930 0x7f2c5c0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c63fe1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c5c1591b0 0x7f2c5c159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c63fe1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5c0b2ad0 con 0x7f2c5c15d560 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c63fe1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5c0b4160 con 0x7f2c5c1591b0 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c63fe1700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c5c0b2230 con 0x7f2c5c15d930 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c6257e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2c5c1591b0 0x7f2c5c159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c61d7d700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2c5c15d560 0x7f2c5c0b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47934/0 (socket says 172.21.15.26:47934) 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c61d7d700 1 -- 172.21.15.26:0/2226972196 learned_addr learned my addr 172.21.15.26:0/2226972196 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c6157c700 1 --2- 172.21.15.26:0/2226972196 >> v2:172.21.15.190:3300/0 conn(0x7f2c5c15d930 0x7f2c5c0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c6257e700 1 -- 172.21.15.26:0/2226972196 >> v2:172.21.15.190:3300/0 conn(0x7f2c5c15d930 msgr2=0x7f2c5c0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c6257e700 1 --2- 172.21.15.26:0/2226972196 >> v2:172.21.15.190:3300/0 conn(0x7f2c5c15d930 0x7f2c5c0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c6257e700 1 -- 172.21.15.26:0/2226972196 >> v1:172.21.15.26:6789/0 conn(0x7f2c5c15d560 legacy=0x7f2c5c0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.501+0000 7f2c6257e700 1 -- 172.21.15.26:0/2226972196 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0b2510 con 0x7f2c5c1591b0 2023-09-28T00:15:25.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c6257e700 1 --2- 172.21.15.26:0/2226972196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 0x7f2c5c159600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c15e440 tx=0x7f2c4c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55f794c28adaaca server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c60d7b700 1 -- 172.21.15.26:0/2226972196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00e070 con 0x7f2c5c1591b0 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c60d7b700 1 -- 172.21.15.26:0/2226972196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c00bc30 con 0x7f2c5c1591b0 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c60d7b700 1 -- 172.21.15.26:0/2226972196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c012430 con 0x7f2c5c1591b0 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2226972196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 msgr2=0x7f2c5c159600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c63fe1700 1 --2- 172.21.15.26:0/2226972196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 0x7f2c5c159600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c15e440 tx=0x7f2c4c009780 comp rx=0 tx=0).stop 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2226972196 shutdown_connections 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c63fe1700 1 --2- 172.21.15.26:0/2226972196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 0x7f2c5c159600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c63fe1700 1 --2- 172.21.15.26:0/2226972196 >> v2:172.21.15.190:3300/0 conn(0x7f2c5c15d930 0x7f2c5c0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2226972196 >> 172.21.15.26:0/2226972196 conn(0x7f2c5c0d1180 msgr2=0x7f2c5c069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2226972196 shutdown_connections 2023-09-28T00:15:25.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.502+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2226972196 wait complete. 2023-09-28T00:15:25.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.503+0000 7f2c63fe1700 1 Processor -- start 2023-09-28T00:15:25.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c63fe1700 1 -- start start 2023-09-28T00:15:25.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c63fe1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 0x7f2c5c16d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c63fe1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c5c15d560 0x7f2c5c15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c63fe1700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5c15d930 0x7f2c5c0694c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c63fe1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c16e140 con 0x7f2c5c1591b0 2023-09-28T00:15:25.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c63fe1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c15bf60 con 0x7f2c5c15d560 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c63fe1700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5c16d8a0 con 0x7f2c5c15d930 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c61d7d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 0x7f2c5c16d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c61d7d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 0x7f2c5c16d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43172/0 (socket says 172.21.15.26:43172) 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c61d7d700 1 -- 172.21.15.26:0/2885962171 learned_addr learned my addr 172.21.15.26:0/2885962171 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c6157c700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c5c15d560 0x7f2c5c15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.504+0000 7f2c6257e700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5c15d930 0x7f2c5c0694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c61d7d700 1 -- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5c15d930 msgr2=0x7f2c5c0694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c61d7d700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5c15d930 0x7f2c5c0694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c61d7d700 1 -- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c5c15d560 msgr2=0x7f2c5c15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c61d7d700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c5c15d560 0x7f2c5c15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c61d7d700 1 -- 172.21.15.26:0/2885962171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c009a20 con 0x7f2c5c1591b0 2023-09-28T00:15:25.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c61d7d700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 0x7f2c5c16d210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c5400c7f0 tx=0x7f2c54007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c59ffb700 1 -- 172.21.15.26:0/2885962171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54005b30 con 0x7f2c5c1591b0 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c59ffb700 1 -- 172.21.15.26:0/2885962171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c54005cb0 con 0x7f2c5c1591b0 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c5c16db80 con 0x7f2c5c1591b0 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c59ffb700 1 -- 172.21.15.26:0/2885962171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54004a80 con 0x7f2c5c1591b0 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.505+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5c14d550 con 0x7f2c5c1591b0 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.506+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5c14d770 con 0x7f2c5c1591b0 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.506+0000 7f2c59ffb700 1 -- 172.21.15.26:0/2885962171 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f2c540070d0 con 0x7f2c5c1591b0 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.507+0000 7f2c59ffb700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2c48067330 0x7f2c480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.507+0000 7f2c59ffb700 1 -- 172.21.15.26:0/2885962171 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2c54083b30 con 0x7f2c5c1591b0 2023-09-28T00:15:25.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.507+0000 7f2c6157c700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2c48067330 0x7f2c480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.507+0000 7f2c6157c700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2c48067330 0x7f2c480697e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c50006fd0 tx=0x7f2c50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:25.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.511+0000 7f2c59ffb700 1 -- 172.21.15.26:0/2885962171 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f2c5404b570 con 0x7f2c5c1591b0 2023-09-28T00:15:25.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.706+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c5c064050 con 0x7f2c5c1591b0 2023-09-28T00:15:25.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.707+0000 7f2c59ffb700 1 -- 172.21.15.26:0/2885962171 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13647 (secure 0 0 0) 0x7f2c54050d80 con 0x7f2c5c1591b0 2023-09-28T00:15:25.708 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:25.709 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:24.941680+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2c48067330 msgr2=0x7f2c480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2c48067330 0x7f2c480697e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2c50006fd0 tx=0x7f2c50008040 comp rx=0 tx=0).stop 2023-09-28T00:15:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 msgr2=0x7f2c5c16d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 0x7f2c5c16d210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c5400c7f0 tx=0x7f2c54007f70 comp rx=0 tx=0).stop 2023-09-28T00:15:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 shutdown_connections 2023-09-28T00:15:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f2c48067330 0x7f2c480697e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2c5c15d930 0x7f2c5c0694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c5c1591b0 0x7f2c5c16d210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 --2- 172.21.15.26:0/2885962171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2c5c15d560 0x7f2c5c15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 >> 172.21.15.26:0/2885962171 conn(0x7f2c5c0d1180 msgr2=0x7f2c5c0682a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 shutdown_connections 2023-09-28T00:15:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.709+0000 7f2c63fe1700 1 -- 172.21.15.26:0/2885962171 wait complete. 2023-09-28T00:15:25.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T00:15:15.721561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T00:15:22.381112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-28T00:15:25.723 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T00:15:25.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.843+0000 7fde0efd9700 1 Processor -- start 2023-09-28T00:15:25.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.843+0000 7fde0efd9700 1 -- start start 2023-09-28T00:15:25.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0efd9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fde08142e90 0x7fde08069810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0efd9700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde08069380 con 0x7fde0815d9a0 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0efd9700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde080b63a0 con 0x7fde08069d50 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0efd9700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde08068770 con 0x7fde08142e90 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0e7d8700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fde0815d9a0 0x7fde080b5c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47944/0 (socket says 172.21.15.26:47944) 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0e7d8700 1 -- 172.21.15.26:0/352465204 learned_addr learned my addr 172.21.15.26:0/352465204 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0dfd7700 1 --2- 172.21.15.26:0/352465204 >> v2:172.21.15.190:3300/0 conn(0x7fde08142e90 0x7fde08069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701247675 0 0) 0x7fde08069380 con 0x7fde0815d9a0 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf4003570 con 0x7fde0815d9a0 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3417475424 0 0) 0x7fddf4003570 con 0x7fde0815d9a0 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 >> v2:172.21.15.190:3300/0 conn(0x7fde08142e90 msgr2=0x7fde08069810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:25.848 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0cfd5700 1 --2- 172.21.15.26:0/352465204 >> v2:172.21.15.190:3300/0 conn(0x7fde08142e90 0x7fde08069810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 >> v1:172.21.15.190:6789/0 conn(0x7fde08069d50 legacy=0x7fde0815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.844+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08068a50 con 0x7fde0815d9a0 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fde000017f0 con 0x7fde0815d9a0 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 >> v1:172.21.15.26:6789/0 conn(0x7fde0815d9a0 legacy=0x7fde080b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddf4003ab0 0x7fddf4003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddf4004810 0x7fddf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf4005210 0x7fddf400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde08068770 con 0x7fddf4005210 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf400c1b0 con 0x7fddf4004810 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf400c370 con 0x7fddf4003ab0 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0e7d8700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf4005210 0x7fddf400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0dfd7700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddf4003ab0 0x7fddf4003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0d7d6700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddf4004810 0x7fddf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0e7d8700 1 -- 172.21.15.26:0/352465204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddf4003ab0 msgr2=0x7fddf4003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0e7d8700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddf4003ab0 0x7fddf4003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0e7d8700 1 -- 172.21.15.26:0/352465204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddf4004810 msgr2=0x7fddf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0e7d8700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddf4004810 0x7fddf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.850 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0e7d8700 1 -- 172.21.15.26:0/352465204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf4003570 con 0x7fddf4005210 2023-09-28T00:15:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0e7d8700 1 -- 172.21.15.26:0/352465204 reap_dead start 2023-09-28T00:15:25.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0e7d8700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf4005210 0x7fddf400ba60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde0000a860 tx=0x7fde00002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325734d1ad3d2ffe server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:25.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde000070f0 con 0x7fddf4005210 2023-09-28T00:15:25.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00007270 con 0x7fddf4005210 2023-09-28T00:15:25.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.845+0000 7fde0cfd5700 1 -- 172.21.15.26:0/352465204 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00007630 con 0x7fddf4005210 2023-09-28T00:15:25.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.846+0000 7fde0efd9700 1 -- 172.21.15.26:0/352465204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf4005210 msgr2=0x7fddf400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.846+0000 7fde0efd9700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf4005210 0x7fddf400ba60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fde0000a860 tx=0x7fde00002100 comp rx=0 tx=0).stop 2023-09-28T00:15:25.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.846+0000 7fde0efd9700 1 -- 172.21.15.26:0/352465204 shutdown_connections 2023-09-28T00:15:25.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.846+0000 7fde0efd9700 1 --2- 172.21.15.26:0/352465204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddf4005210 0x7fddf400ba60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.846+0000 7fde0efd9700 1 -- 172.21.15.26:0/352465204 >> 172.21.15.26:0/352465204 conn(0x7fde080ccfe0 msgr2=0x7fde080cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:25.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.846+0000 7fde0efd9700 1 -- 172.21.15.26:0/352465204 shutdown_connections 2023-09-28T00:15:25.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.846+0000 7fde0efd9700 1 -- 172.21.15.26:0/352465204 wait complete. 2023-09-28T00:15:25.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.847+0000 7fde0efd9700 1 Processor -- start 2023-09-28T00:15:25.856 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.847+0000 7fde0efd9700 1 -- start start 2023-09-28T00:15:25.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0efd9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddf4005210 0x7fde08158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0efd9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde08141060 0x7fde081414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0efd9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde0806ce90 0x7fde0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0efd9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde08141a10 con 0x7fde08141060 2023-09-28T00:15:25.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0efd9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0815ae20 con 0x7fde0806ce90 2023-09-28T00:15:25.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0efd9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0815b100 con 0x7fddf4005210 2023-09-28T00:15:25.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0d7d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde08141060 0x7fde081414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0d7d6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde08141060 0x7fde081414d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43194/0 (socket says 172.21.15.26:43194) 2023-09-28T00:15:25.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0d7d6700 1 -- 172.21.15.26:0/1019850499 learned_addr learned my addr 172.21.15.26:0/1019850499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:25.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0dfd7700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddf4005210 0x7fde08158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0e7d8700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde0806ce90 0x7fde0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0d7d6700 1 -- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddf4005210 msgr2=0x7fde08158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0d7d6700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddf4005210 0x7fde08158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0d7d6700 1 -- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde0806ce90 msgr2=0x7fde0806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:25.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0d7d6700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde0806ce90 0x7fde0806d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:25.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0d7d6700 1 -- 172.21.15.26:0/1019850499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0815b3e0 con 0x7fde08141060 2023-09-28T00:15:25.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.848+0000 7fde0d7d6700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde08141060 0x7fde081414d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddf8014fd0 tx=0x7fddf8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:25.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.849+0000 7fddfdffb700 1 -- 172.21.15.26:0/1019850499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf8019040 con 0x7fde08141060 2023-09-28T00:15:25.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.849+0000 7fddfdffb700 1 -- 172.21.15.26:0/1019850499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf8002e30 con 0x7fde08141060 2023-09-28T00:15:25.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.849+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0815b6c0 con 0x7fde08141060 2023-09-28T00:15:25.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.849+0000 7fddfdffb700 1 -- 172.21.15.26:0/1019850499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf801e6b0 con 0x7fde08141060 2023-09-28T00:15:25.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.849+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0806d870 con 0x7fde08141060 2023-09-28T00:15:25.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.850+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0815ba30 con 0x7fde08141060 2023-09-28T00:15:25.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.850+0000 7fddfdffb700 1 -- 172.21.15.26:0/1019850499 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fddf801ea20 con 0x7fde08141060 2023-09-28T00:15:25.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.851+0000 7fddfdffb700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fddec067330 0x7fddec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:25.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.851+0000 7fddfdffb700 1 -- 172.21.15.26:0/1019850499 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fddf808c9f0 con 0x7fde08141060 2023-09-28T00:15:25.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.851+0000 7fde0dfd7700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fddec067330 0x7fddec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:25.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.851+0000 7fde0dfd7700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fddec067330 0x7fddec0697e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde04006ed0 tx=0x7fde04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:25.860 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:25.855+0000 7fddfdffb700 1 -- 172.21.15.26:0/1019850499 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fddf8057570 con 0x7fde08141060 2023-09-28T00:15:26.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.049+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde0804c3c0 con 0x7fde08141060 2023-09-28T00:15:26.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.050+0000 7fddfdffb700 1 -- 172.21.15.26:0/1019850499 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddf8023020 con 0x7fde08141060 2023-09-28T00:15:26.051 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-09-28T00:15:26.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fddec067330 msgr2=0x7fddec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fddec067330 0x7fddec0697e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fde04006ed0 tx=0x7fde04008040 comp rx=0 tx=0).stop 2023-09-28T00:15:26.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde08141060 msgr2=0x7fde081414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde08141060 0x7fde081414d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddf8014fd0 tx=0x7fddf8016040 comp rx=0 tx=0).stop 2023-09-28T00:15:26.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 shutdown_connections 2023-09-28T00:15:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fddec067330 0x7fddec0697e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddf4005210 0x7fde08158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fde0806ce90 0x7fde0806d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 --2- 172.21.15.26:0/1019850499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde08141060 0x7fde081414d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 >> 172.21.15.26:0/1019850499 conn(0x7fde080ccfe0 msgr2=0x7fde081420c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 shutdown_connections 2023-09-28T00:15:26.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.052+0000 7fde0efd9700 1 -- 172.21.15.26:0/1019850499 wait complete. 2023-09-28T00:15:26.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T00:15:26.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.188+0000 7fe8d5d06700 1 Processor -- start 2023-09-28T00:15:26.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.188+0000 7fe8d5d06700 1 -- start start 2023-09-28T00:15:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.188+0000 7fe8d5d06700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8d015cb10 0x7fe8d00af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.188+0000 7fe8d5d06700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d00698e0 con 0x7fe8d00b1690 2023-09-28T00:15:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.188+0000 7fe8d5d06700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d015a260 con 0x7fe8d00b4000 2023-09-28T00:15:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.188+0000 7fe8d5d06700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d0068fd0 con 0x7fe8d015cb10 2023-09-28T00:15:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8cf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8d015cb10 0x7fe8d00af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8cffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe8d00b1690 0x7fe8d0069d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47948/0 (socket says 172.21.15.26:47948) 2023-09-28T00:15:26.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8cf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe8d015cb10 0x7fe8d00af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43208/0 (socket says 172.21.15.26:43208) 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8cffff700 1 -- 172.21.15.26:0/3566177894 learned_addr learned my addr 172.21.15.26:0/3566177894 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8cf7fe700 1 -- 172.21.15.26:0/3566177894 >> v1:172.21.15.190:6789/0 conn(0x7fe8d00b4000 legacy=0x7fe8d0159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8cf7fe700 1 -- 172.21.15.26:0/3566177894 >> v1:172.21.15.26:6789/0 conn(0x7fe8d00b1690 legacy=0x7fe8d0069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8cf7fe700 1 -- 172.21.15.26:0/3566177894 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00b0020 con 0x7fe8d015cb10 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8ce7fc700 1 -- 172.21.15.26:0/3566177894 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937800280 0 0) 0x7fe8d00698e0 con 0x7fe8d00b1690 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8cf7fe700 1 --2- 172.21.15.26:0/3566177894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d015cb10 0x7fe8d00af780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00098e0 tx=0x7fe8c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e52349d74c7d6e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8ce7fc700 1 -- 172.21.15.26:0/3566177894 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0009e80 con 0x7fe8d015cb10 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8ce7fc700 1 -- 172.21.15.26:0/3566177894 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000b860 con 0x7fe8d015cb10 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.189+0000 7fe8ce7fc700 1 -- 172.21.15.26:0/3566177894 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000bbe0 con 0x7fe8d015cb10 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.190+0000 7fe8d5d06700 1 -- 172.21.15.26:0/3566177894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d015cb10 msgr2=0x7fe8d00af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.190+0000 7fe8d5d06700 1 --2- 172.21.15.26:0/3566177894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d015cb10 0x7fe8d00af780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00098e0 tx=0x7fe8c00091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.190+0000 7fe8d5d06700 1 -- 172.21.15.26:0/3566177894 shutdown_connections 2023-09-28T00:15:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.190+0000 7fe8d5d06700 1 --2- 172.21.15.26:0/3566177894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d015cb10 0x7fe8d00af780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.190+0000 7fe8d5d06700 1 -- 172.21.15.26:0/3566177894 >> 172.21.15.26:0/3566177894 conn(0x7fe8d006d890 msgr2=0x7fe8d006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.190+0000 7fe8d5d06700 1 -- 172.21.15.26:0/3566177894 shutdown_connections 2023-09-28T00:15:26.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.190+0000 7fe8d5d06700 1 -- 172.21.15.26:0/3566177894 wait complete. 2023-09-28T00:15:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.191+0000 7fe8d5d06700 1 Processor -- start 2023-09-28T00:15:26.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.191+0000 7fe8d5d06700 1 -- start start 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8d5d06700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d00b1690 0x7fe8d00cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8d5d06700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d00b4000 0x7fe8d00cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8d5d06700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d015cb10 0x7fe8d016a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8d5d06700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00a6970 con 0x7fe8d00b1690 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8d5d06700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cc090 con 0x7fe8d00b4000 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8d5d06700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00c83f0 con 0x7fe8d015cb10 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d00b1690 0x7fe8d00cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d00b1690 0x7fe8d00cb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43222/0 (socket says 172.21.15.26:43222) 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cf7fe700 1 -- 172.21.15.26:0/2195158960 learned_addr learned my addr 172.21.15.26:0/2195158960 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cf7fe700 1 -- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d015cb10 msgr2=0x7fe8d016a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cffff700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d015cb10 0x7fe8d016a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8ceffd700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d00b4000 0x7fe8d00cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cf7fe700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d015cb10 0x7fe8d016a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cf7fe700 1 -- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d00b4000 msgr2=0x7fe8d00cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cf7fe700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d00b4000 0x7fe8d00cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cf7fe700 1 -- 172.21.15.26:0/2195158960 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0009420 con 0x7fe8d00b1690 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8cf7fe700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d00b1690 0x7fe8d00cb460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00091e0 tx=0x7fe8c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8b77fe700 1 -- 172.21.15.26:0/2195158960 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000ba50 con 0x7fe8d00b1690 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8b77fe700 1 -- 172.21.15.26:0/2195158960 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c0020070 con 0x7fe8d00b1690 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d00cc2a0 con 0x7fe8d00b1690 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.192+0000 7fe8b77fe700 1 -- 172.21.15.26:0/2195158960 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c001b6a0 con 0x7fe8d00b1690 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.193+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d00cc860 con 0x7fe8d00b1690 2023-09-28T00:15:26.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.193+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d0064050 con 0x7fe8d00b1690 2023-09-28T00:15:26.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.194+0000 7fe8b77fe700 1 -- 172.21.15.26:0/2195158960 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe8c0022030 con 0x7fe8d00b1690 2023-09-28T00:15:26.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.194+0000 7fe8b77fe700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe8bc0673b0 0x7fe8bc069860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.194+0000 7fe8b77fe700 1 -- 172.21.15.26:0/2195158960 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe8c00868b0 con 0x7fe8d00b1690 2023-09-28T00:15:26.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.194+0000 7fe8ceffd700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe8bc0673b0 0x7fe8bc069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.195+0000 7fe8ceffd700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe8bc0673b0 0x7fe8bc069860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00cae10 tx=0x7fe8c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:26.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.199+0000 7fe8b77fe700 1 -- 172.21.15.26:0/2195158960 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe8c0053a60 con 0x7fe8d00b1690 2023-09-28T00:15:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.391+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8d0064050 con 0x7fe8d00b1690 2023-09-28T00:15:26.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.391+0000 7fe8b77fe700 1 -- 172.21.15.26:0/2195158960 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe8c0023e60 con 0x7fe8d00b1690 2023-09-28T00:15:26.393 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-09-28T00:15:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.393+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe8bc0673b0 msgr2=0x7fe8bc069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe8bc0673b0 0x7fe8bc069860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00cae10 tx=0x7fe8c4009040 comp rx=0 tx=0).stop 2023-09-28T00:15:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d00b1690 msgr2=0x7fe8d00cb460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d00b1690 0x7fe8d00cb460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00091e0 tx=0x7fe8c0016000 comp rx=0 tx=0).stop 2023-09-28T00:15:26.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 shutdown_connections 2023-09-28T00:15:26.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe8bc0673b0 0x7fe8bc069860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8d015cb10 0x7fe8d016a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8d00b1690 0x7fe8d00cb460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 --2- 172.21.15.26:0/2195158960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8d00b4000 0x7fe8d00cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 >> 172.21.15.26:0/2195158960 conn(0x7fe8d006d890 msgr2=0x7fe8d015bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 shutdown_connections 2023-09-28T00:15:26.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.394+0000 7fe8d5d06700 1 -- 172.21.15.26:0/2195158960 wait complete. 2023-09-28T00:15:26.407 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-28T00:15:26.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.525+0000 7fe19c377700 1 Processor -- start 2023-09-28T00:15:26.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.525+0000 7fe19c377700 1 -- start start 2023-09-28T00:15:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe19c377700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940b5600 0x7fe1940d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe19c377700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1940b2ad0 con 0x7fe19415d930 2023-09-28T00:15:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe19c377700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1940b4160 con 0x7fe19415d560 2023-09-28T00:15:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe19c377700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1940b2230 con 0x7fe1940b5600 2023-09-28T00:15:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199912700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe19415d930 0x7fe1941591b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47958/0 (socket says 172.21.15.26:47958) 2023-09-28T00:15:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199912700 1 -- 172.21.15.26:0/2878777111 learned_addr learned my addr 172.21.15.26:0/2878777111 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe19a914700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940b5600 0x7fe1940d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804334743 0 0) 0x7fe1940b2ad0 con 0x7fe19415d930 2023-09-28T00:15:26.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe180003570 con 0x7fe19415d930 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2482790043 0 0) 0x7fe180003570 con 0x7fe19415d930 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940b5600 msgr2=0x7fe1940d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940b5600 0x7fe1940d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 >> v1:172.21.15.190:6789/0 conn(0x7fe19415d560 legacy=0x7fe1940b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1940b2510 con 0x7fe19415d930 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fe184001470 con 0x7fe19415d930 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 >> v1:172.21.15.26:6789/0 conn(0x7fe19415d930 legacy=0x7fe1941591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe180003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe180004810 0x7fe180004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940b5600 0x7fe1800051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1940b2230 con 0x7fe180003a90 2023-09-28T00:15:26.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18000bb90 con 0x7fe180004810 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.526+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18000bd50 con 0x7fe1940b5600 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe19a113700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe180003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe19a914700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940b5600 0x7fe1800051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe199912700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe180004810 0x7fe180004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe19a113700 1 -- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940b5600 msgr2=0x7fe1800051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe19a113700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940b5600 0x7fe1800051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe19a113700 1 -- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe180004810 msgr2=0x7fe180004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe19a113700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe180004810 0x7fe180004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe19a113700 1 -- 172.21.15.26:0/2878777111 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180003570 con 0x7fe180003a90 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe199912700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe180004810 0x7fe180004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe19a914700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940b5600 0x7fe1800051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:26.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe19a113700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe180003ea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe190001fc0 tx=0x7fe190001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43485b117987e21 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190001950 con 0x7fe180003a90 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000c8b0 con 0x7fe180003a90 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.527+0000 7fe199111700 1 -- 172.21.15.26:0/2878777111 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000cc50 con 0x7fe180003a90 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.528+0000 7fe19c377700 1 -- 172.21.15.26:0/2878777111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 msgr2=0x7fe180003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.528+0000 7fe19c377700 1 --2- 172.21.15.26:0/2878777111 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe180003ea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe190001fc0 tx=0x7fe190001640 comp rx=0 tx=0).stop 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.528+0000 7fe19a914700 1 -- 172.21.15.26:0/2878777111 reap_dead start 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.528+0000 7fe19c377700 1 -- 172.21.15.26:0/2878777111 shutdown_connections 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.528+0000 7fe19c377700 1 -- 172.21.15.26:0/2878777111 >> 172.21.15.26:0/2878777111 conn(0x7fe1940d1180 msgr2=0x7fe194069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.528+0000 7fe19c377700 1 -- 172.21.15.26:0/2878777111 shutdown_connections 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.528+0000 7fe19c377700 1 -- 172.21.15.26:0/2878777111 wait complete. 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.529+0000 7fe19c377700 1 Processor -- start 2023-09-28T00:15:26.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.529+0000 7fe19c377700 1 -- start start 2023-09-28T00:15:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19c377700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe1941556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19c377700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19415bf60 0x7fe19415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19c377700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940c9860 0x7fe1940c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19c377700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19415c910 con 0x7fe180003a90 2023-09-28T00:15:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19c377700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19416dd40 con 0x7fe19415bf60 2023-09-28T00:15:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19c377700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19416d130 con 0x7fe1940c9860 2023-09-28T00:15:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a113700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe1941556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a113700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe1941556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43236/0 (socket says 172.21.15.26:43236) 2023-09-28T00:15:26.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a113700 1 -- 172.21.15.26:0/848592732 learned_addr learned my addr 172.21.15.26:0/848592732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe199912700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19415bf60 0x7fe19415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a914700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940c9860 0x7fe1940c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a113700 1 -- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940c9860 msgr2=0x7fe1940c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a113700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940c9860 0x7fe1940c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a113700 1 -- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19415bf60 msgr2=0x7fe19415c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a113700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19415bf60 0x7fe19415c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a113700 1 -- 172.21.15.26:0/848592732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19416d410 con 0x7fe180003a90 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19a113700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe1941556f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe19000c6a0 tx=0x7fe190015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe18a7fc700 1 -- 172.21.15.26:0/848592732 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000ca20 con 0x7fe180003a90 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe18a7fc700 1 -- 172.21.15.26:0/848592732 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000cb80 con 0x7fe180003a90 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19416d6f0 con 0x7fe180003a90 2023-09-28T00:15:26.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe18a7fc700 1 -- 172.21.15.26:0/848592732 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190006df0 con 0x7fe180003a90 2023-09-28T00:15:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.530+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1940ca220 con 0x7fe180003a90 2023-09-28T00:15:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.531+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe194064050 con 0x7fe180003a90 2023-09-28T00:15:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.532+0000 7fe18a7fc700 1 -- 172.21.15.26:0/848592732 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe19001f620 con 0x7fe180003a90 2023-09-28T00:15:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.532+0000 7fe18a7fc700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe178067330 0x7fe1780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.532+0000 7fe18a7fc700 1 -- 172.21.15.26:0/848592732 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe190086530 con 0x7fe180003a90 2023-09-28T00:15:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.532+0000 7fe199912700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe178067330 0x7fe1780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.533+0000 7fe199912700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe178067330 0x7fe1780697e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe184001010 tx=0x7fe184009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:26.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.537+0000 7fe18a7fc700 1 -- 172.21.15.26:0/848592732 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe190053780 con 0x7fe180003a90 2023-09-28T00:15:26.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.732+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe1940b27f0 con 0x7fe180003a90 2023-09-28T00:15:26.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.733+0000 7fe18a7fc700 1 -- 172.21.15.26:0/848592732 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe190017090 con 0x7fe180003a90 2023-09-28T00:15:26.734 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:26.734 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-09-28T00:15:26.734 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-09-28T00:15:26.734 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-09-28T00:15:26.734 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-09-28T00:15:26.734 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-09-28T00:15:26.734 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-09-28T00:15:26.734 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 2, 2023-09-28T00:15:26.735 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": "rbd" 2023-09-28T00:15:26.735 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-09-28T00:15:26.735 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-09-28T00:15:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe178067330 msgr2=0x7fe1780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe178067330 0x7fe1780697e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe184001010 tx=0x7fe184009040 comp rx=0 tx=0).stop 2023-09-28T00:15:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 msgr2=0x7fe1941556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe1941556f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe19000c6a0 tx=0x7fe190015000 comp rx=0 tx=0).stop 2023-09-28T00:15:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 shutdown_connections 2023-09-28T00:15:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe178067330 0x7fe1780697e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1940c9860 0x7fe1940c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe180003a90 0x7fe1941556f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 --2- 172.21.15.26:0/848592732 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe19415bf60 0x7fe19415c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 >> 172.21.15.26:0/848592732 conn(0x7fe1940d1180 msgr2=0x7fe1940cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 shutdown_connections 2023-09-28T00:15:26.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.735+0000 7fe19c377700 1 -- 172.21.15.26:0/848592732 wait complete. 2023-09-28T00:15:26.748 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-28T00:15:26.748 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-28T00:15:26.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.869+0000 7efe1759e700 1 Processor -- start 2023-09-28T00:15:26.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.870+0000 7efe1759e700 1 -- start start 2023-09-28T00:15:26.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.870+0000 7efe1759e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe180cf440 0x7efe180cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.870+0000 7efe1759e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf810 0x7efe180cc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.870+0000 7efe1759e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe180cb670 con 0x7efe180cc680 2023-09-28T00:15:26.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.870+0000 7efe1759e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe180cce90 con 0x7efe180cf440 2023-09-28T00:15:26.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1759e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe180cad80 con 0x7efe180cf810 2023-09-28T00:15:26.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe180cf440 0x7efe180cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1659c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe180cf440 0x7efe180cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43242/0 (socket says 172.21.15.26:43242) 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1659c700 1 -- 172.21.15.26:0/478370652 learned_addr learned my addr 172.21.15.26:0/478370652 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe15d9b700 1 --2- 172.21.15.26:0/478370652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf810 0x7efe180cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1659c700 1 -- 172.21.15.26:0/478370652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf810 msgr2=0x7efe180cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1659c700 1 --2- 172.21.15.26:0/478370652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf810 0x7efe180cc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1659c700 1 -- 172.21.15.26:0/478370652 >> v1:172.21.15.190:6789/0 conn(0x7efe180cc680 legacy=0x7efe1815d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1659c700 1 -- 172.21.15.26:0/478370652 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe180cb020 con 0x7efe180cf440 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1659c700 1 --2- 172.21.15.26:0/478370652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf440 0x7efe180cbb00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe08009f20 tx=0x7efe08009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4d0f27530b095b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1559a700 1 -- 172.21.15.26:0/478370652 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0800e070 con 0x7efe180cf440 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1559a700 1 -- 172.21.15.26:0/478370652 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0800b9d0 con 0x7efe180cf440 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.871+0000 7efe1559a700 1 -- 172.21.15.26:0/478370652 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080092e0 con 0x7efe180cf440 2023-09-28T00:15:26.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.872+0000 7efe1759e700 1 -- 172.21.15.26:0/478370652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf440 msgr2=0x7efe180cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.872+0000 7efe1759e700 1 --2- 172.21.15.26:0/478370652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf440 0x7efe180cbb00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe08009f20 tx=0x7efe08009840 comp rx=0 tx=0).stop 2023-09-28T00:15:26.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.872+0000 7efe1759e700 1 -- 172.21.15.26:0/478370652 shutdown_connections 2023-09-28T00:15:26.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.872+0000 7efe1759e700 1 --2- 172.21.15.26:0/478370652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf440 0x7efe180cbb00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.872+0000 7efe1759e700 1 --2- 172.21.15.26:0/478370652 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf810 0x7efe180cc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.872+0000 7efe1759e700 1 -- 172.21.15.26:0/478370652 >> 172.21.15.26:0/478370652 conn(0x7efe180cd080 msgr2=0x7efe180cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:26.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.872+0000 7efe1759e700 1 -- 172.21.15.26:0/478370652 shutdown_connections 2023-09-28T00:15:26.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.872+0000 7efe1759e700 1 -- 172.21.15.26:0/478370652 wait complete. 2023-09-28T00:15:26.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.873+0000 7efe1759e700 1 Processor -- start 2023-09-28T00:15:26.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.873+0000 7efe1759e700 1 -- start start 2023-09-28T00:15:26.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe1759e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe180cc680 0x7efe181507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe1759e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf440 0x7efe180c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe1759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf810 0x7efe180b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe1759e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe180c9bb0 con 0x7efe180cf810 2023-09-28T00:15:26.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe1759e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1816d7d0 con 0x7efe180cc680 2023-09-28T00:15:26.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe1759e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1816d1c0 con 0x7efe180cf440 2023-09-28T00:15:26.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe16d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf810 0x7efe180b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe1659c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe180cc680 0x7efe181507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe16d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf810 0x7efe180b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43248/0 (socket says 172.21.15.26:43248) 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe15d9b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf440 0x7efe180c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe16d9d700 1 -- 172.21.15.26:0/213623481 learned_addr learned my addr 172.21.15.26:0/213623481 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe16d9d700 1 -- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf440 msgr2=0x7efe180c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe16d9d700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf440 0x7efe180c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe16d9d700 1 -- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe180cc680 msgr2=0x7efe181507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe16d9d700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe180cc680 0x7efe181507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe16d9d700 1 -- 172.21.15.26:0/213623481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08009ae0 con 0x7efe180cf810 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe16d9d700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf810 0x7efe180b4cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe1000c560 tx=0x7efe10007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe0e7fc700 1 -- 172.21.15.26:0/213623481 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10011590 con 0x7efe180cf810 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe0e7fc700 1 -- 172.21.15.26:0/213623481 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe100116f0 con 0x7efe180cf810 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe180c98d0 con 0x7efe180cf810 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.874+0000 7efe0e7fc700 1 -- 172.21.15.26:0/213623481 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10011ab0 con 0x7efe180cf810 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.875+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe18150cf0 con 0x7efe180cf810 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.875+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1816d020 con 0x7efe180cf810 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.876+0000 7efe0e7fc700 1 -- 172.21.15.26:0/213623481 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efe1001b3b0 con 0x7efe180cf810 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.876+0000 7efe0e7fc700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efdf8067330 0x7efdf80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.876+0000 7efe0e7fc700 1 -- 172.21.15.26:0/213623481 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efe10083be0 con 0x7efe180cf810 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.877+0000 7efe1659c700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efdf8067330 0x7efdf80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:26.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.877+0000 7efe1659c700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efdf8067330 0x7efdf80697e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe18154f60 tx=0x7efe08018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:26.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:26.881+0000 7efe0e7fc700 1 -- 172.21.15.26:0/213623481 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efe1816d020 con 0x7efe180cf810 2023-09-28T00:15:27.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.076+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efe1816d020 con 0x7efe180cf810 2023-09-28T00:15:27.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.957+0000 7efe0e7fc700 1 -- 172.21.15.26:0/213623481 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7efe1816d020 con 0x7efe180cf810 2023-09-28T00:15:27.963 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efdf8067330 msgr2=0x7efdf80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efdf8067330 0x7efdf80697e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efe18154f60 tx=0x7efe08018000 comp rx=0 tx=0).stop 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf810 msgr2=0x7efe180b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf810 0x7efe180b4cd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe1000c560 tx=0x7efe10007ef0 comp rx=0 tx=0).stop 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 shutdown_connections 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efdf8067330 0x7efdf80697e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe180cf810 0x7efe180b4cd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe180cc680 0x7efe181507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 --2- 172.21.15.26:0/213623481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe180cf440 0x7efe180c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.962+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 >> 172.21.15.26:0/213623481 conn(0x7efe180cd080 msgr2=0x7efe180c6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.963+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 shutdown_connections 2023-09-28T00:15:27.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:27.963+0000 7efe1759e700 1 -- 172.21.15.26:0/213623481 wait complete. 2023-09-28T00:15:27.967 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-09-28T00:15:27.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-28T00:15:28.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.111+0000 7f8b81217700 1 Processor -- start 2023-09-28T00:15:28.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.111+0000 7f8b81217700 1 -- start start 2023-09-28T00:15:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b81217700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b7c159890 0x7f8b7c0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b81217700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c0cd860 con 0x7f8b7c0cdcf0 2023-09-28T00:15:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b81217700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c0ccc50 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b81217700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7c0ce190 con 0x7f8b7c159890 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b7ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b7c159890 0x7f8b7c0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b7ad9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b7c159890 0x7f8b7c0b0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43264/0 (socket says 172.21.15.26:43264) 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b7a59c700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8b7c0cdcf0 0x7f8b7c0b14d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47974/0 (socket says 172.21.15.26:47974) 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b7ad9d700 1 -- 172.21.15.26:0/1381015523 learned_addr learned my addr 172.21.15.26:0/1381015523 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b7ad9d700 1 -- 172.21.15.26:0/1381015523 >> v1:172.21.15.190:6789/0 conn(0x7f8b7c0b1be0 legacy=0x7f8b7c159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b7ad9d700 1 -- 172.21.15.26:0/1381015523 >> v1:172.21.15.26:6789/0 conn(0x7f8b7c0cdcf0 legacy=0x7f8b7c0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b7ad9d700 1 -- 172.21.15.26:0/1381015523 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c0ccf30 con 0x7f8b7c159890 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b79d9b700 1 -- 172.21.15.26:0/1381015523 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3820711967 0 0) 0x7f8b7c0cd860 con 0x7f8b7c0cdcf0 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b7ad9d700 1 --2- 172.21.15.26:0/1381015523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c159890 0x7f8b7c0b0eb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009f70 tx=0x7f8b6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdab5eb805277ad server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.112+0000 7f8b79d9b700 1 -- 172.21.15.26:0/1381015523 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c00e070 con 0x7f8b7c159890 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.113+0000 7f8b79d9b700 1 -- 172.21.15.26:0/1381015523 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c00bad0 con 0x7f8b7c159890 2023-09-28T00:15:28.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.113+0000 7f8b79d9b700 1 -- 172.21.15.26:0/1381015523 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c0092e0 con 0x7f8b7c159890 2023-09-28T00:15:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.113+0000 7f8b81217700 1 -- 172.21.15.26:0/1381015523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c159890 msgr2=0x7f8b7c0b0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.113+0000 7f8b81217700 1 --2- 172.21.15.26:0/1381015523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c159890 0x7f8b7c0b0eb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009f70 tx=0x7f8b6c009840 comp rx=0 tx=0).stop 2023-09-28T00:15:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.113+0000 7f8b81217700 1 -- 172.21.15.26:0/1381015523 shutdown_connections 2023-09-28T00:15:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.113+0000 7f8b81217700 1 --2- 172.21.15.26:0/1381015523 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c159890 0x7f8b7c0b0eb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.113+0000 7f8b81217700 1 -- 172.21.15.26:0/1381015523 >> 172.21.15.26:0/1381015523 conn(0x7f8b7c099990 msgr2=0x7f8b7c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.113+0000 7f8b81217700 1 -- 172.21.15.26:0/1381015523 shutdown_connections 2023-09-28T00:15:28.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.113+0000 7f8b81217700 1 -- 172.21.15.26:0/1381015523 wait complete. 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.114+0000 7f8b81217700 1 Processor -- start 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.114+0000 7f8b81217700 1 -- start start 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b81217700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c0b1be0 0x7f8b7c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b81217700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0cdcf0 0x7f8b7c0aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b81217700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c159890 0x7f8b7c169a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b81217700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c157400 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b81217700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c15c140 con 0x7f8b7c0cdcf0 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b81217700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c15b810 con 0x7f8b7c159890 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c0b1be0 0x7f8b7c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:28.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c0b1be0 0x7f8b7c156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43272/0 (socket says 172.21.15.26:43272) 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7ad9d700 1 -- 172.21.15.26:0/1469651207 learned_addr learned my addr 172.21.15.26:0/1469651207 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7a59c700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0cdcf0 0x7f8b7c0aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7b59e700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c159890 0x7f8b7c169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7ad9d700 1 -- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c159890 msgr2=0x7f8b7c169a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7ad9d700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c159890 0x7f8b7c169a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7ad9d700 1 -- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0cdcf0 msgr2=0x7f8b7c0aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7ad9d700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0cdcf0 0x7f8b7c0aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7ad9d700 1 -- 172.21.15.26:0/1469651207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c009ae0 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.115+0000 7f8b7a59c700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0cdcf0 0x7f8b7c0aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.116+0000 7f8b7ad9d700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c0b1be0 0x7f8b7c156ec0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c088b30 tx=0x7f8b6c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.116+0000 7f8b72ffd700 1 -- 172.21.15.26:0/1469651207 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c007b00 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.116+0000 7f8b72ffd700 1 -- 172.21.15.26:0/1469651207 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6c007c80 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.116+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c15baf0 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.116+0000 7f8b72ffd700 1 -- 172.21.15.26:0/1469651207 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c025460 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.116+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c0af370 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.117+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7c064050 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.117+0000 7f8b72ffd700 1 -- 172.21.15.26:0/1469651207 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8b6c01c410 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.117+0000 7f8b72ffd700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8b5c067330 0x7f8b5c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.118+0000 7f8b72ffd700 1 -- 172.21.15.26:0/1469651207 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f8b6c086730 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.118+0000 7f8b7a59c700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8b5c067330 0x7f8b5c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:28.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.118+0000 7f8b7a59c700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8b5c067330 0x7f8b5c0697e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0d1710 tx=0x7f8b64007c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:28.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.122+0000 7f8b72ffd700 1 -- 172.21.15.26:0/1469651207 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8b6c053820 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.316+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8b7c089e10 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.967+0000 7f8b72ffd700 1 -- 172.21.15.26:0/1469651207 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8b6c056e40 con 0x7f8b7c0b1be0 2023-09-28T00:15:28.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.975+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8b5c067330 msgr2=0x7f8b5c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:28.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.975+0000 7f8b81217700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8b5c067330 0x7f8b5c0697e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c0d1710 tx=0x7f8b64007c90 comp rx=0 tx=0).stop 2023-09-28T00:15:28.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.975+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c0b1be0 msgr2=0x7f8b7c156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:28.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.975+0000 7f8b81217700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c0b1be0 0x7f8b7c156ec0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c088b30 tx=0x7f8b6c018000 comp rx=0 tx=0).stop 2023-09-28T00:15:28.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.976+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 shutdown_connections 2023-09-28T00:15:28.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.976+0000 7f8b81217700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8b5c067330 0x7f8b5c0697e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:28.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.976+0000 7f8b81217700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b7c159890 0x7f8b7c169a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:28.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.976+0000 7f8b81217700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b7c0b1be0 0x7f8b7c156ec0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:28.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.976+0000 7f8b81217700 1 --2- 172.21.15.26:0/1469651207 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b7c0cdcf0 0x7f8b7c0aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:28.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.976+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 >> 172.21.15.26:0/1469651207 conn(0x7f8b7c099990 msgr2=0x7f8b7c0affc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:28.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.976+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 shutdown_connections 2023-09-28T00:15:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:28.977+0000 7f8b81217700 1 -- 172.21.15.26:0/1469651207 wait complete. 2023-09-28T00:15:28.987 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-09-28T00:15:28.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-28T00:15:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.121+0000 7f1347bd9700 1 Processor -- start 2023-09-28T00:15:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.121+0000 7f1347bd9700 1 -- start start 2023-09-28T00:15:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.122+0000 7f1347bd9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1340159500 0x7f13401598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.122+0000 7f1347bd9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134015dab0 0x7f13400cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.122+0000 7f1347bd9700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13400b1110 con 0x7f13400b3fd0 2023-09-28T00:15:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.122+0000 7f1347bd9700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13400b13b0 con 0x7f1340159500 2023-09-28T00:15:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.122+0000 7f1347bd9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400b1690 con 0x7f134015dab0 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1346176700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134015dab0 0x7f13400cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1345975700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1340159500 0x7f13401598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1345174700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f13400b3fd0 0x7f134015d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:41460/0 (socket says 172.21.15.26:41460) 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1345174700 1 -- 172.21.15.26:0/322380735 learned_addr learned my addr 172.21.15.26:0/322380735 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1345975700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1340159500 0x7f13401598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:38478/0 (socket says 172.21.15.26:38478) 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1346176700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134015dab0 0x7f13400cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:48312/0 (socket says 172.21.15.26:48312) 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1344973700 1 -- 172.21.15.26:0/322380735 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670195907 0 0) 0x7f13400b1110 con 0x7f13400b3fd0 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1344973700 1 -- 172.21.15.26:0/322380735 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1328003570 con 0x7f13400b3fd0 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1345975700 1 -- 172.21.15.26:0/322380735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134015dab0 msgr2=0x7f13400cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1345975700 1 --2- 172.21.15.26:0/322380735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134015dab0 0x7f13400cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1345975700 1 -- 172.21.15.26:0/322380735 >> v1:172.21.15.190:6789/0 conn(0x7f13400b3fd0 legacy=0x7f134015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1345975700 1 -- 172.21.15.26:0/322380735 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400b1970 con 0x7f1340159500 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1346176700 1 --2- 172.21.15.26:0/322380735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134015dab0 0x7f13400cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1345975700 1 --2- 172.21.15.26:0/322380735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1340159500 0x7f13401598d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f13300098e0 tx=0x7f13300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34e0bd9ac9fdd958 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1344973700 1 -- 172.21.15.26:0/322380735 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330011630 con 0x7f1340159500 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1344973700 1 -- 172.21.15.26:0/322380735 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330011790 con 0x7f1340159500 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.123+0000 7f1344973700 1 -- 172.21.15.26:0/322380735 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330011b30 con 0x7f1340159500 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.124+0000 7f1347bd9700 1 -- 172.21.15.26:0/322380735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1340159500 msgr2=0x7f13401598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.124+0000 7f1347bd9700 1 --2- 172.21.15.26:0/322380735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1340159500 0x7f13401598d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f13300098e0 tx=0x7f13300091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.124+0000 7f1347bd9700 1 -- 172.21.15.26:0/322380735 shutdown_connections 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.124+0000 7f1347bd9700 1 --2- 172.21.15.26:0/322380735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f134015dab0 0x7f13400cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.124+0000 7f1347bd9700 1 --2- 172.21.15.26:0/322380735 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1340159500 0x7f13401598d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.124+0000 7f1347bd9700 1 -- 172.21.15.26:0/322380735 >> 172.21.15.26:0/322380735 conn(0x7f1340067630 msgr2=0x7f1340069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.124+0000 7f1347bd9700 1 -- 172.21.15.26:0/322380735 shutdown_connections 2023-09-28T00:15:29.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.124+0000 7f1347bd9700 1 -- 172.21.15.26:0/322380735 wait complete. 2023-09-28T00:15:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.125+0000 7f1347bd9700 1 Processor -- start 2023-09-28T00:15:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.125+0000 7f1347bd9700 1 -- start start 2023-09-28T00:15:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1347bd9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13400b3fd0 0x7f1340142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1347bd9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1340159500 0x7f134015b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1347bd9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f134015dab0 0x7f13400b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1347bd9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134015cc10 con 0x7f1340159500 2023-09-28T00:15:29.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1347bd9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1340150380 con 0x7f134015dab0 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1347bd9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134015bd20 con 0x7f13400b3fd0 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345174700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1340159500 0x7f134015b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345174700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1340159500 0x7f134015b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43276/0 (socket says 172.21.15.26:43276) 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345174700 1 -- 172.21.15.26:0/825173146 learned_addr learned my addr 172.21.15.26:0/825173146 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1346176700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f134015dab0 0x7f13400b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345975700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13400b3fd0 0x7f1340142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345174700 1 -- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13400b3fd0 msgr2=0x7f1340142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345174700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13400b3fd0 0x7f1340142050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345174700 1 -- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f134015dab0 msgr2=0x7f13400b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345174700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f134015dab0 0x7f13400b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345174700 1 -- 172.21.15.26:0/825173146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1338009a20 con 0x7f1340159500 2023-09-28T00:15:29.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.126+0000 7f1345174700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1340159500 0x7f134015b3b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f133400c590 tx=0x7f1334007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.127+0000 7f133dffb700 1 -- 172.21.15.26:0/825173146 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334005cd0 con 0x7f1340159500 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.127+0000 7f133dffb700 1 -- 172.21.15.26:0/825173146 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1334005e50 con 0x7f1340159500 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.127+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1330009420 con 0x7f1340159500 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.127+0000 7f133dffb700 1 -- 172.21.15.26:0/825173146 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1334007320 con 0x7f1340159500 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.127+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134015c2e0 con 0x7f1340159500 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.128+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1340152f80 con 0x7f1340159500 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.128+0000 7f133dffb700 1 -- 172.21.15.26:0/825173146 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f133401b3b0 con 0x7f1340159500 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.129+0000 7f133dffb700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f132c067330 0x7f132c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.129+0000 7f133dffb700 1 -- 172.21.15.26:0/825173146 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f1334084220 con 0x7f1340159500 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.129+0000 7f1345975700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f132c067330 0x7f132c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.129+0000 7f1345975700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f132c067330 0x7f132c0697e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f13300091e0 tx=0x7f1330017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:29.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.133+0000 7f133dffb700 1 -- 172.21.15.26:0/825173146 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f13340511a0 con 0x7f1340159500 2023-09-28T00:15:29.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.369+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1340064050 con 0x7f1340159500 2023-09-28T00:15:29.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.375+0000 7f133dffb700 1 -- 172.21.15.26:0/825173146 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f13340547c0 con 0x7f1340159500 2023-09-28T00:15:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.379+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f132c067330 msgr2=0x7f132c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.379+0000 7f1347bd9700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f132c067330 0x7f132c0697e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f13300091e0 tx=0x7f1330017000 comp rx=0 tx=0).stop 2023-09-28T00:15:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.379+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1340159500 msgr2=0x7f134015b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.379+0000 7f1347bd9700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1340159500 0x7f134015b3b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f133400c590 tx=0x7f1334007e00 comp rx=0 tx=0).stop 2023-09-28T00:15:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.387+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 shutdown_connections 2023-09-28T00:15:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.387+0000 7f1347bd9700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f132c067330 0x7f132c0697e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.387+0000 7f1347bd9700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13400b3fd0 0x7f1340142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.387+0000 7f1347bd9700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f134015dab0 0x7f13400b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.387+0000 7f1347bd9700 1 --2- 172.21.15.26:0/825173146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1340159500 0x7f134015b3b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.387+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 >> 172.21.15.26:0/825173146 conn(0x7f1340067630 msgr2=0x7f13400b5f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.387+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 shutdown_connections 2023-09-28T00:15:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.388+0000 7f1347bd9700 1 -- 172.21.15.26:0/825173146 wait complete. 2023-09-28T00:15:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 3 and data pool 4 2023-09-28T00:15:29.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.526+0000 7f6bca1ec700 1 Processor -- start 2023-09-28T00:15:29.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.526+0000 7f6bca1ec700 1 -- start start 2023-09-28T00:15:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.526+0000 7f6bca1ec700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bc40b5600 0x7f6bc40d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.526+0000 7f6bca1ec700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40b2ad0 con 0x7f6bc415d930 2023-09-28T00:15:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.526+0000 7f6bca1ec700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40b4160 con 0x7f6bc415d560 2023-09-28T00:15:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.526+0000 7f6bca1ec700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc40b2230 con 0x7f6bc40b5600 2023-09-28T00:15:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6bc40b5600 0x7f6bc40d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc2ffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6bc415d930 0x7f6bc41591b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47976/0 (socket says 172.21.15.26:47976) 2023-09-28T00:15:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc2ffd700 1 -- 172.21.15.26:0/1194446067 learned_addr learned my addr 172.21.15.26:0/1194446067 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc3fff700 1 -- 172.21.15.26:0/1194446067 >> v1:172.21.15.190:6789/0 conn(0x7f6bc415d560 legacy=0x7f6bc40b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc3fff700 1 -- 172.21.15.26:0/1194446067 >> v1:172.21.15.26:6789/0 conn(0x7f6bc415d930 legacy=0x7f6bc41591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc27fc700 1 -- 172.21.15.26:0/1194446067 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358602125 0 0) 0x7f6bc40b4160 con 0x7f6bc415d560 2023-09-28T00:15:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc3fff700 1 -- 172.21.15.26:0/1194446067 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40b2510 con 0x7f6bc40b5600 2023-09-28T00:15:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc3fff700 1 --2- 172.21.15.26:0/1194446067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 0x7f6bc40d0030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009e60 tx=0x7f6bbc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6989f5a01ac7a37 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:29.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc27fc700 1 -- 172.21.15.26:0/1194446067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00e070 con 0x7f6bc40b5600 2023-09-28T00:15:29.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc27fc700 1 -- 172.21.15.26:0/1194446067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc00bb30 con 0x7f6bc40b5600 2023-09-28T00:15:29.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.527+0000 7f6bc27fc700 1 -- 172.21.15.26:0/1194446067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00bed0 con 0x7f6bc40b5600 2023-09-28T00:15:29.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.528+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1194446067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 msgr2=0x7f6bc40d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.528+0000 7f6bca1ec700 1 --2- 172.21.15.26:0/1194446067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 0x7f6bc40d0030 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009e60 tx=0x7f6bbc009780 comp rx=0 tx=0).stop 2023-09-28T00:15:29.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.528+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1194446067 shutdown_connections 2023-09-28T00:15:29.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.528+0000 7f6bca1ec700 1 --2- 172.21.15.26:0/1194446067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 0x7f6bc40d0030 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.528+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1194446067 >> 172.21.15.26:0/1194446067 conn(0x7f6bc40d1180 msgr2=0x7f6bc4069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:29.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.528+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1194446067 shutdown_connections 2023-09-28T00:15:29.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.528+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1194446067 wait complete. 2023-09-28T00:15:29.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.529+0000 7f6bca1ec700 1 Processor -- start 2023-09-28T00:15:29.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.529+0000 7f6bca1ec700 1 -- start start 2023-09-28T00:15:29.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bca1ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 0x7f6bc414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bca1ec700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc415d560 0x7f6bc4152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bca1ec700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bc415d930 0x7f6bc4153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bca1ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc414ee60 con 0x7f6bc40b5600 2023-09-28T00:15:29.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bca1ec700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc414fc80 con 0x7f6bc415d560 2023-09-28T00:15:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bca1ec700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc414f070 con 0x7f6bc415d930 2023-09-28T00:15:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 0x7f6bc414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 0x7f6bc414ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43286/0 (socket says 172.21.15.26:43286) 2023-09-28T00:15:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc37fe700 1 -- 172.21.15.26:0/1597882509 learned_addr learned my addr 172.21.15.26:0/1597882509 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc3fff700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bc415d930 0x7f6bc4153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc2ffd700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc415d560 0x7f6bc4152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc37fe700 1 -- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bc415d930 msgr2=0x7f6bc4153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc37fe700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bc415d930 0x7f6bc4153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc37fe700 1 -- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc415d560 msgr2=0x7f6bc4152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc37fe700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc415d560 0x7f6bc4152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc37fe700 1 -- 172.21.15.26:0/1597882509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009a20 con 0x7f6bc40b5600 2023-09-28T00:15:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc2ffd700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc415d560 0x7f6bc4152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.530+0000 7f6bc37fe700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 0x7f6bc414ccc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400c7e0 tx=0x7f6bb4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.531+0000 7f6bbb7fe700 1 -- 172.21.15.26:0/1597882509 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4011590 con 0x7f6bc40b5600 2023-09-28T00:15:29.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.531+0000 7f6bbb7fe700 1 -- 172.21.15.26:0/1597882509 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb4011710 con 0x7f6bc40b5600 2023-09-28T00:15:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.531+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc414f350 con 0x7f6bc40b5600 2023-09-28T00:15:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.531+0000 7f6bbb7fe700 1 -- 172.21.15.26:0/1597882509 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4011ad0 con 0x7f6bc40b5600 2023-09-28T00:15:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.531+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc414f910 con 0x7f6bc40b5600 2023-09-28T00:15:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.531+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc4064050 con 0x7f6bc40b5600 2023-09-28T00:15:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.532+0000 7f6bbb7fe700 1 -- 172.21.15.26:0/1597882509 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6bb401b3b0 con 0x7f6bc40b5600 2023-09-28T00:15:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.532+0000 7f6bbb7fe700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ba4067330 0x7f6ba40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.532+0000 7f6bbb7fe700 1 -- 172.21.15.26:0/1597882509 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bb40841d0 con 0x7f6bc40b5600 2023-09-28T00:15:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.533+0000 7f6bc2ffd700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ba4067330 0x7f6ba40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.533+0000 7f6bc2ffd700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ba4067330 0x7f6ba40697e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007fd0 tx=0x7f6bac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:29.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.536+0000 7f6bbb7fe700 1 -- 172.21.15.26:0/1597882509 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6bb4051030 con 0x7f6bc40b5600 2023-09-28T00:15:29.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.729+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bc40b27f0 con 0x7f6bc40b5600 2023-09-28T00:15:29.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.730+0000 7f6bbb7fe700 1 -- 172.21.15.26:0/1597882509 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f6bb4054650 con 0x7f6bc40b5600 2023-09-28T00:15:29.732 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:29.732 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:29.371782+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:29.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ba4067330 msgr2=0x7f6ba40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ba4067330 0x7f6ba40697e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007fd0 tx=0x7f6bac009040 comp rx=0 tx=0).stop 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 msgr2=0x7f6bc414ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 0x7f6bc414ccc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400c7e0 tx=0x7f6bb4007df0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 shutdown_connections 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ba4067330 0x7f6ba40697e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6bc415d930 0x7f6bc4153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6bc40b5600 0x7f6bc414ccc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 --2- 172.21.15.26:0/1597882509 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6bc415d560 0x7f6bc4152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 >> 172.21.15.26:0/1597882509 conn(0x7f6bc40d1180 msgr2=0x7f6bc4067630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 shutdown_connections 2023-09-28T00:15:29.734 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.732+0000 7f6bca1ec700 1 -- 172.21.15.26:0/1597882509 wait complete. 2023-09-28T00:15:29.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:29.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.864+0000 7fbfb1748700 1 Processor -- start 2023-09-28T00:15:29.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.864+0000 7fbfb1748700 1 -- start start 2023-09-28T00:15:29.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfb1748700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbfac15d3c0 0x7fbfac158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfb1748700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d790 0x7fbfac1593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfb1748700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac069430 con 0x7fbfac0b0840 2023-09-28T00:15:29.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfb1748700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0b36f0 con 0x7fbfac15d3c0 2023-09-28T00:15:29.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfb1748700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac069710 con 0x7fbfac15d790 2023-09-28T00:15:29.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfab7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbfac0b0840 0x7fbfac0b0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47982/0 (socket says 172.21.15.26:47982) 2023-09-28T00:15:29.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfab7fe700 1 -- 172.21.15.26:0/1736471838 learned_addr learned my addr 172.21.15.26:0/1736471838 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:29.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfaa7fc700 1 --2- 172.21.15.26:0/1736471838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d790 0x7fbfac1593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfaaffd700 1 --2- 172.21.15.26:0/1736471838 >> v2:172.21.15.190:3300/0 conn(0x7fbfac15d3c0 0x7fbfac158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfa9ffb700 1 -- 172.21.15.26:0/1736471838 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460657437 0 0) 0x7fbfac069430 con 0x7fbfac0b0840 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.865+0000 7fbfa9ffb700 1 -- 172.21.15.26:0/1736471838 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf98003570 con 0x7fbfac0b0840 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfa9ffb700 1 -- 172.21.15.26:0/1736471838 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3956131679 0 0) 0x7fbf98003570 con 0x7fbfac0b0840 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfaa7fc700 1 -- 172.21.15.26:0/1736471838 >> v2:172.21.15.190:3300/0 conn(0x7fbfac15d3c0 msgr2=0x7fbfac158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfaa7fc700 1 --2- 172.21.15.26:0/1736471838 >> v2:172.21.15.190:3300/0 conn(0x7fbfac15d3c0 0x7fbfac158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfaa7fc700 1 -- 172.21.15.26:0/1736471838 >> v1:172.21.15.26:6789/0 conn(0x7fbfac0b0840 legacy=0x7fbfac0b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfaa7fc700 1 -- 172.21.15.26:0/1736471838 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0699f0 con 0x7fbfac15d790 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfaaffd700 1 --2- 172.21.15.26:0/1736471838 >> v2:172.21.15.190:3300/0 conn(0x7fbfac15d3c0 0x7fbfac158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfaa7fc700 1 --2- 172.21.15.26:0/1736471838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d790 0x7fbfac1593f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbf940098e0 tx=0x7fbf940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80f2734c571787c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:29.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfa9ffb700 1 -- 172.21.15.26:0/1736471838 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40017f0 con 0x7fbfac15d790 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfa9ffb700 1 -- 172.21.15.26:0/1736471838 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf94011420 con 0x7fbfac15d790 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.866+0000 7fbfa9ffb700 1 -- 172.21.15.26:0/1736471838 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf940117a0 con 0x7fbfac15d790 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.867+0000 7fbfb1748700 1 -- 172.21.15.26:0/1736471838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d790 msgr2=0x7fbfac1593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.867+0000 7fbfb1748700 1 --2- 172.21.15.26:0/1736471838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d790 0x7fbfac1593f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbf940098e0 tx=0x7fbf940091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.867+0000 7fbfb1748700 1 -- 172.21.15.26:0/1736471838 shutdown_connections 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.867+0000 7fbfb1748700 1 --2- 172.21.15.26:0/1736471838 >> v2:172.21.15.190:3300/0 conn(0x7fbfac15d3c0 0x7fbfac158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.867+0000 7fbfb1748700 1 --2- 172.21.15.26:0/1736471838 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d790 0x7fbfac1593f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.867+0000 7fbfb1748700 1 -- 172.21.15.26:0/1736471838 >> 172.21.15.26:0/1736471838 conn(0x7fbfac0ccfe0 msgr2=0x7fbfac0cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.867+0000 7fbfb1748700 1 -- 172.21.15.26:0/1736471838 shutdown_connections 2023-09-28T00:15:29.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.867+0000 7fbfb1748700 1 -- 172.21.15.26:0/1736471838 wait complete. 2023-09-28T00:15:29.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.868+0000 7fbfb1748700 1 Processor -- start 2023-09-28T00:15:29.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.868+0000 7fbfb1748700 1 -- start start 2023-09-28T00:15:29.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfb1748700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfac0b0840 0x7fbfac14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfb1748700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d3c0 0x7fbfac15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfb1748700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac15d790 0x7fbfac16d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfb1748700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac16e380 con 0x7fbfac15d790 2023-09-28T00:15:29.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfb1748700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac153510 con 0x7fbfac0b0840 2023-09-28T00:15:29.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfb1748700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac1537f0 con 0x7fbfac15d3c0 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac15d790 0x7fbfac16d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfab7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac15d790 0x7fbfac16d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43296/0 (socket says 172.21.15.26:43296) 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfab7fe700 1 -- 172.21.15.26:0/645343992 learned_addr learned my addr 172.21.15.26:0/645343992 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfaaffd700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfac0b0840 0x7fbfac14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfaa7fc700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d3c0 0x7fbfac15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfab7fe700 1 -- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d3c0 msgr2=0x7fbfac15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfab7fe700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d3c0 0x7fbfac15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfab7fe700 1 -- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfac0b0840 msgr2=0x7fbfac14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfab7fe700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfac0b0840 0x7fbfac14dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfab7fe700 1 -- 172.21.15.26:0/645343992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c009420 con 0x7fbfac15d790 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfaaffd700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfac0b0840 0x7fbfac14dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:29.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfab7fe700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac15d790 0x7fbfac16d4f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400cc20 tx=0x7fbfa40015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfa2ffd700 1 -- 172.21.15.26:0/645343992 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4004dc0 con 0x7fbfac15d790 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfa2ffd700 1 -- 172.21.15.26:0/645343992 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa400a7b0 con 0x7fbfac15d790 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf94009420 con 0x7fbfac15d790 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfa2ffd700 1 -- 172.21.15.26:0/645343992 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400ab70 con 0x7fbfac15d790 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.869+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac153db0 con 0x7fbfac15d790 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.870+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac04c3c0 con 0x7fbfac15d790 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.871+0000 7fbfa2ffd700 1 -- 172.21.15.26:0/645343992 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbfa4007150 con 0x7fbfac15d790 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.871+0000 7fbfa2ffd700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbf8c067330 0x7fbf8c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.871+0000 7fbfa2ffd700 1 -- 172.21.15.26:0/645343992 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbfa4084390 con 0x7fbfac15d790 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.871+0000 7fbfaaffd700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbf8c067330 0x7fbf8c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:29.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.872+0000 7fbfaaffd700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbf8c067330 0x7fbf8c0697e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0093f0 tx=0x7fbf9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:29.876 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:29.876+0000 7fbfa2ffd700 1 -- 172.21.15.26:0/645343992 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbfa4051310 con 0x7fbfac15d790 2023-09-28T00:15:30.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.069+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfac069cd0 con 0x7fbfac15d790 2023-09-28T00:15:30.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.070+0000 7fbfa2ffd700 1 -- 172.21.15.26:0/645343992 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16879 (secure 0 0 0) 0x7fbfa4054930 con 0x7fbfac15d790 2023-09-28T00:15:30.071 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:30.072 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:29.371782+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:30.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbf8c067330 msgr2=0x7fbf8c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:30.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbf8c067330 0x7fbf8c0697e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0093f0 tx=0x7fbf9c008040 comp rx=0 tx=0).stop 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac15d790 msgr2=0x7fbfac16d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac15d790 0x7fbfac16d4f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400cc20 tx=0x7fbfa40015b0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 shutdown_connections 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbf8c067330 0x7fbf8c0697e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac15d790 0x7fbfac16d4f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbfac0b0840 0x7fbfac14dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 --2- 172.21.15.26:0/645343992 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbfac15d3c0 0x7fbfac15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 >> 172.21.15.26:0/645343992 conn(0x7fbfac0ccfe0 msgr2=0x7fbfac0b2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 shutdown_connections 2023-09-28T00:15:30.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.072+0000 7fbfb1748700 1 -- 172.21.15.26:0/645343992 wait complete. 2023-09-28T00:15:30.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-28T00:15:30.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:15:30.146 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:15:30.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.208+0000 7fa4b2aba700 1 Processor -- start 2023-09-28T00:15:30.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.208+0000 7fa4b2aba700 1 -- start start 2023-09-28T00:15:30.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b2aba700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa4ac1598d0 0x7fa4ac15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b2aba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4ac15d8e0 0x7fa4ac0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b2aba700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac15dd20 con 0x7fa4ac159500 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b2aba700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac0b1110 con 0x7fa4ac15d8e0 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b2aba700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac0b13b0 con 0x7fa4ac1598d0 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b1057700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4ac15d8e0 0x7fa4ac0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b1057700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa4ac15d8e0 0x7fa4ac0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43304/0 (socket says 172.21.15.26:43304) 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b1057700 1 -- 172.21.15.26:0/398883818 learned_addr learned my addr 172.21.15.26:0/398883818 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4abfff700 1 --2- 172.21.15.26:0/398883818 >> v2:172.21.15.190:3300/0 conn(0x7fa4ac1598d0 0x7fa4ac15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b1057700 1 -- 172.21.15.26:0/398883818 >> v2:172.21.15.190:3300/0 conn(0x7fa4ac1598d0 msgr2=0x7fa4ac15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b1057700 1 --2- 172.21.15.26:0/398883818 >> v2:172.21.15.190:3300/0 conn(0x7fa4ac1598d0 0x7fa4ac15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b1057700 1 -- 172.21.15.26:0/398883818 >> v1:172.21.15.190:6789/0 conn(0x7fa4ac159500 legacy=0x7fa4ac0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b1057700 1 -- 172.21.15.26:0/398883818 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0b1690 con 0x7fa4ac15d8e0 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4b1057700 1 --2- 172.21.15.26:0/398883818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac15d8e0 0x7fa4ac0cf6c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac063430 tx=0x7fa49c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a768cb1905ea8e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4ab7fe700 1 -- 172.21.15.26:0/398883818 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c009e70 con 0x7fa4ac15d8e0 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4ab7fe700 1 -- 172.21.15.26:0/398883818 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c00b860 con 0x7fa4ac15d8e0 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.209+0000 7fa4ab7fe700 1 -- 172.21.15.26:0/398883818 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c00bc00 con 0x7fa4ac15d8e0 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.210+0000 7fa4b2aba700 1 -- 172.21.15.26:0/398883818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac15d8e0 msgr2=0x7fa4ac0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.210+0000 7fa4b2aba700 1 --2- 172.21.15.26:0/398883818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac15d8e0 0x7fa4ac0cf6c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac063430 tx=0x7fa49c009250 comp rx=0 tx=0).stop 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.210+0000 7fa4b2aba700 1 -- 172.21.15.26:0/398883818 shutdown_connections 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.210+0000 7fa4b2aba700 1 --2- 172.21.15.26:0/398883818 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac15d8e0 0x7fa4ac0cf6c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.210+0000 7fa4b2aba700 1 --2- 172.21.15.26:0/398883818 >> v2:172.21.15.190:3300/0 conn(0x7fa4ac1598d0 0x7fa4ac15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.210+0000 7fa4b2aba700 1 -- 172.21.15.26:0/398883818 >> 172.21.15.26:0/398883818 conn(0x7fa4ac067630 msgr2=0x7fa4ac069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:30.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.210+0000 7fa4b2aba700 1 -- 172.21.15.26:0/398883818 shutdown_connections 2023-09-28T00:15:30.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.210+0000 7fa4b2aba700 1 -- 172.21.15.26:0/398883818 wait complete. 2023-09-28T00:15:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.211+0000 7fa4b2aba700 1 Processor -- start 2023-09-28T00:15:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.211+0000 7fa4b2aba700 1 -- start start 2023-09-28T00:15:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b2aba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac159500 0x7fa4ac15a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b2aba700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4ac1598d0 0x7fa4ac16a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b2aba700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4ac15d8e0 0x7fa4ac16a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b2aba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac16b910 con 0x7fa4ac159500 2023-09-28T00:15:30.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b2aba700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac15aac0 con 0x7fa4ac15d8e0 2023-09-28T00:15:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b2aba700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac16afe0 con 0x7fa4ac1598d0 2023-09-28T00:15:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b0856700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac159500 0x7fa4ac15a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b0856700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac159500 0x7fa4ac15a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43316/0 (socket says 172.21.15.26:43316) 2023-09-28T00:15:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b0856700 1 -- 172.21.15.26:0/134582102 learned_addr learned my addr 172.21.15.26:0/134582102 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b1057700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4ac15d8e0 0x7fa4ac16a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4abfff700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4ac1598d0 0x7fa4ac16a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b0856700 1 -- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4ac1598d0 msgr2=0x7fa4ac16a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b0856700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4ac1598d0 0x7fa4ac16a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b0856700 1 -- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4ac15d8e0 msgr2=0x7fa4ac16a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b0856700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4ac15d8e0 0x7fa4ac16a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b0856700 1 -- 172.21.15.26:0/134582102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c0094f0 con 0x7fa4ac159500 2023-09-28T00:15:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.212+0000 7fa4b1057700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4ac15d8e0 0x7fa4ac16a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.213+0000 7fa4b0856700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac159500 0x7fa4ac15a0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400cb10 tx=0x7fa4a40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.213+0000 7fa4a8ff9700 1 -- 172.21.15.26:0/134582102 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400a760 con 0x7fa4ac159500 2023-09-28T00:15:30.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.213+0000 7fa4a8ff9700 1 -- 172.21.15.26:0/134582102 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a400a8e0 con 0x7fa4ac159500 2023-09-28T00:15:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.213+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ac16b2c0 con 0x7fa4ac159500 2023-09-28T00:15:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.213+0000 7fa4a8ff9700 1 -- 172.21.15.26:0/134582102 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a400aca0 con 0x7fa4ac159500 2023-09-28T00:15:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.213+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac15a6a0 con 0x7fa4ac159500 2023-09-28T00:15:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.214+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ac064050 con 0x7fa4ac159500 2023-09-28T00:15:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.214+0000 7fa4a8ff9700 1 -- 172.21.15.26:0/134582102 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa4a4003030 con 0x7fa4ac159500 2023-09-28T00:15:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.214+0000 7fa4a8ff9700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa498067330 0x7fa4980697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.215+0000 7fa4a8ff9700 1 -- 172.21.15.26:0/134582102 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa4a4084c60 con 0x7fa4ac159500 2023-09-28T00:15:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.215+0000 7fa4abfff700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa498067330 0x7fa4980697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:30.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.215+0000 7fa4abfff700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa498067330 0x7fa4980697e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00093f0 tx=0x7fa4a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:30.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.219+0000 7fa4a8ff9700 1 -- 172.21.15.26:0/134582102 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa4a4051b60 con 0x7fa4ac159500 2023-09-28T00:15:30.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:30.457+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa4ac159ec0 con 0x7fa4ac159500 2023-09-28T00:15:31.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.385+0000 7fa4a8ff9700 1 -- 172.21.15.26:0/134582102 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa4a4055180 con 0x7fa4ac159500 2023-09-28T00:15:31.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa498067330 msgr2=0x7fa4980697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa498067330 0x7fa4980697e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00093f0 tx=0x7fa4a0008040 comp rx=0 tx=0).stop 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac159500 msgr2=0x7fa4ac15a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac159500 0x7fa4ac15a0e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa4a400cb10 tx=0x7fa4a40017b0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 shutdown_connections 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa498067330 0x7fa4980697e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa4ac15d8e0 0x7fa4ac16a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4ac159500 0x7fa4ac15a0e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 --2- 172.21.15.26:0/134582102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa4ac1598d0 0x7fa4ac16a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.387+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 >> 172.21.15.26:0/134582102 conn(0x7fa4ac067630 msgr2=0x7fa4ac069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.388+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 shutdown_connections 2023-09-28T00:15:31.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.388+0000 7fa4b2aba700 1 -- 172.21.15.26:0/134582102 wait complete. 2023-09-28T00:15:31.403 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-28T00:15:31.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-28T00:15:31.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.574+0000 7ffb5327d700 1 Processor -- start 2023-09-28T00:15:31.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.574+0000 7ffb5327d700 1 -- start start 2023-09-28T00:15:31.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5327d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffb4c1598d0 0x7ffb4c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:31.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5327d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb4c15d8e0 0x7ffb4c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5327d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4c15dd20 con 0x7ffb4c159500 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5327d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4c0b1110 con 0x7ffb4c15d8e0 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5327d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4c0b13b0 con 0x7ffb4c1598d0 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5181a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb4c15d8e0 0x7ffb4c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5181a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb4c15d8e0 0x7ffb4c0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46312/0 (socket says 172.21.15.26:46312) 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5181a700 1 -- 172.21.15.26:0/2457941114 learned_addr learned my addr 172.21.15.26:0/2457941114 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb50818700 1 --2- 172.21.15.26:0/2457941114 >> v2:172.21.15.190:3300/0 conn(0x7ffb4c1598d0 0x7ffb4c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5181a700 1 -- 172.21.15.26:0/2457941114 >> v2:172.21.15.190:3300/0 conn(0x7ffb4c1598d0 msgr2=0x7ffb4c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5181a700 1 --2- 172.21.15.26:0/2457941114 >> v2:172.21.15.190:3300/0 conn(0x7ffb4c1598d0 0x7ffb4c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5181a700 1 -- 172.21.15.26:0/2457941114 >> v1:172.21.15.190:6789/0 conn(0x7ffb4c159500 legacy=0x7ffb4c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:31.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5181a700 1 -- 172.21.15.26:0/2457941114 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c0b1690 con 0x7ffb4c15d8e0 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb50818700 1 --2- 172.21.15.26:0/2457941114 >> v2:172.21.15.190:3300/0 conn(0x7ffb4c1598d0 0x7ffb4c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb5181a700 1 --2- 172.21.15.26:0/2457941114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c15d8e0 0x7ffb4c0cf6c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c063430 tx=0x7ffb44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25dfafea69e93cf server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb43fff700 1 -- 172.21.15.26:0/2457941114 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400e070 con 0x7ffb4c15d8e0 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb43fff700 1 -- 172.21.15.26:0/2457941114 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4400ba50 con 0x7ffb4c15d8e0 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.575+0000 7ffb43fff700 1 -- 172.21.15.26:0/2457941114 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb440092e0 con 0x7ffb4c15d8e0 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.576+0000 7ffb5327d700 1 -- 172.21.15.26:0/2457941114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c15d8e0 msgr2=0x7ffb4c0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.576+0000 7ffb5327d700 1 --2- 172.21.15.26:0/2457941114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c15d8e0 0x7ffb4c0cf6c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c063430 tx=0x7ffb44009840 comp rx=0 tx=0).stop 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.576+0000 7ffb5327d700 1 -- 172.21.15.26:0/2457941114 shutdown_connections 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.576+0000 7ffb5327d700 1 --2- 172.21.15.26:0/2457941114 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c15d8e0 0x7ffb4c0cf6c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.576+0000 7ffb5327d700 1 --2- 172.21.15.26:0/2457941114 >> v2:172.21.15.190:3300/0 conn(0x7ffb4c1598d0 0x7ffb4c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.576+0000 7ffb5327d700 1 -- 172.21.15.26:0/2457941114 >> 172.21.15.26:0/2457941114 conn(0x7ffb4c067630 msgr2=0x7ffb4c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:31.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.576+0000 7ffb5327d700 1 -- 172.21.15.26:0/2457941114 shutdown_connections 2023-09-28T00:15:31.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.576+0000 7ffb5327d700 1 -- 172.21.15.26:0/2457941114 wait complete. 2023-09-28T00:15:31.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.577+0000 7ffb5327d700 1 Processor -- start 2023-09-28T00:15:31.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.577+0000 7ffb5327d700 1 -- start start 2023-09-28T00:15:31.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb5327d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c159500 0x7ffb4c15b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb5327d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c1598d0 0x7ffb4c14d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb5327d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15d8e0 0x7ffb4c0b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb5327d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c15bd60 con 0x7ffb4c1598d0 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb5327d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c14b5a0 con 0x7ffb4c15d8e0 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb5327d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c14f6b0 con 0x7ffb4c159500 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb50818700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c1598d0 0x7ffb4c14d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb50818700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c1598d0 0x7ffb4c14d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46328/0 (socket says 172.21.15.26:46328) 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb50818700 1 -- 172.21.15.26:0/77440688 learned_addr learned my addr 172.21.15.26:0/77440688 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb5181a700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15d8e0 0x7ffb4c0b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.578+0000 7ffb51019700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c159500 0x7ffb4c15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:31.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb50818700 1 -- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c159500 msgr2=0x7ffb4c15b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb50818700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c159500 0x7ffb4c15b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb50818700 1 -- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15d8e0 msgr2=0x7ffb4c0b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb50818700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15d8e0 0x7ffb4c0b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb50818700 1 -- 172.21.15.26:0/77440688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44009ae0 con 0x7ffb4c1598d0 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb51019700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c159500 0x7ffb4c15b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb50818700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c1598d0 0x7ffb4c14d4f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00e8d0 tx=0x7ffb3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb417fa700 1 -- 172.21.15.26:0/77440688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c013410 con 0x7ffb4c1598d0 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb417fa700 1 -- 172.21.15.26:0/77440688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c013570 con 0x7ffb4c1598d0 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c14da30 con 0x7ffb4c1598d0 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb417fa700 1 -- 172.21.15.26:0/77440688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c013910 con 0x7ffb4c1598d0 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.579+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c14ed80 con 0x7ffb4c1598d0 2023-09-28T00:15:31.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.580+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4c064050 con 0x7ffb4c1598d0 2023-09-28T00:15:31.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.580+0000 7ffb417fa700 1 -- 172.21.15.26:0/77440688 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ffb3c013d00 con 0x7ffb4c1598d0 2023-09-28T00:15:31.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.581+0000 7ffb417fa700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb30067330 0x7ffb300697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:31.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.581+0000 7ffb417fa700 1 -- 172.21.15.26:0/77440688 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffb3c084980 con 0x7ffb4c1598d0 2023-09-28T00:15:31.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.581+0000 7ffb51019700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb30067330 0x7ffb300697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:31.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.581+0000 7ffb51019700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb30067330 0x7ffb300697e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb48007fd0 tx=0x7ffb48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:31.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.585+0000 7ffb417fa700 1 -- 172.21.15.26:0/77440688 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ffb3c051880 con 0x7ffb4c1598d0 2023-09-28T00:15:31.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:31.824+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffb4c14f7f0 con 0x7ffb4c1598d0 2023-09-28T00:15:32.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.389+0000 7ffb417fa700 1 -- 172.21.15.26:0/77440688 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffb3c054ea0 con 0x7ffb4c1598d0 2023-09-28T00:15:32.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb30067330 msgr2=0x7ffb300697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb30067330 0x7ffb300697e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb48007fd0 tx=0x7ffb48009040 comp rx=0 tx=0).stop 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c1598d0 msgr2=0x7ffb4c14d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c1598d0 0x7ffb4c14d4f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00e8d0 tx=0x7ffb3c008040 comp rx=0 tx=0).stop 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 shutdown_connections 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb30067330 0x7ffb300697e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c159500 0x7ffb4c15b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15d8e0 0x7ffb4c0b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 --2- 172.21.15.26:0/77440688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c1598d0 0x7ffb4c14d4f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 >> 172.21.15.26:0/77440688 conn(0x7ffb4c067630 msgr2=0x7ffb4c069790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 shutdown_connections 2023-09-28T00:15:32.393 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.391+0000 7ffb5327d700 1 -- 172.21.15.26:0/77440688 wait complete. 2023-09-28T00:15:32.406 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-28T00:15:32.406 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:15:32.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.527+0000 7f29f268f700 1 Processor -- start 2023-09-28T00:15:32.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.527+0000 7f29f268f700 1 -- start start 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f268f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec142d90 0x7f29ec06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f268f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f29ec143160 0x7f29ec0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f268f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29ec0c4900 0x7f29ec0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f268f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec069f50 con 0x7f29ec0c4900 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f268f700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec06a920 con 0x7f29ec143160 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f268f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec069340 con 0x7f29ec142d90 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f0c2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29ec0c4900 0x7f29ec0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f0c2c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f29ec0c4900 0x7f29ec0cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46336/0 (socket says 172.21.15.26:46336) 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f0c2c700 1 -- 172.21.15.26:0/1064986650 learned_addr learned my addr 172.21.15.26:0/1064986650 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:32.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29eb7fe700 1 --2- 172.21.15.26:0/1064986650 >> v2:172.21.15.190:3300/0 conn(0x7f29ec143160 0x7f29ec0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29ebfff700 1 --2- 172.21.15.26:0/1064986650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec142d90 0x7f29ec06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f0c2c700 1 -- 172.21.15.26:0/1064986650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec142d90 msgr2=0x7f29ec06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f0c2c700 1 --2- 172.21.15.26:0/1064986650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec142d90 0x7f29ec06a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f0c2c700 1 -- 172.21.15.26:0/1064986650 >> v2:172.21.15.190:3300/0 conn(0x7f29ec143160 msgr2=0x7f29ec0c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f0c2c700 1 --2- 172.21.15.26:0/1064986650 >> v2:172.21.15.190:3300/0 conn(0x7f29ec143160 0x7f29ec0c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.528+0000 7f29f0c2c700 1 -- 172.21.15.26:0/1064986650 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec069620 con 0x7f29ec0c4900 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29eb7fe700 1 --2- 172.21.15.26:0/1064986650 >> v2:172.21.15.190:3300/0 conn(0x7f29ec143160 0x7f29ec0c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29ebfff700 1 --2- 172.21.15.26:0/1064986650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec142d90 0x7f29ec06a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f0c2c700 1 --2- 172.21.15.26:0/1064986650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec0c4900 0x7f29ec0cc130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29ec06fd90 tx=0x7f29e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b2a34667335b68 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29eaffd700 1 -- 172.21.15.26:0/1064986650 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e400e070 con 0x7f29ec0c4900 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29eaffd700 1 -- 172.21.15.26:0/1064986650 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e400ba50 con 0x7f29ec0c4900 2023-09-28T00:15:32.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29eaffd700 1 -- 172.21.15.26:0/1064986650 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40092e0 con 0x7f29ec0c4900 2023-09-28T00:15:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f268f700 1 -- 172.21.15.26:0/1064986650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec0c4900 msgr2=0x7f29ec0cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f268f700 1 --2- 172.21.15.26:0/1064986650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec0c4900 0x7f29ec0cc130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f29ec06fd90 tx=0x7f29e4009840 comp rx=0 tx=0).stop 2023-09-28T00:15:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f268f700 1 -- 172.21.15.26:0/1064986650 shutdown_connections 2023-09-28T00:15:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f268f700 1 --2- 172.21.15.26:0/1064986650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec0c4900 0x7f29ec0cc130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f268f700 1 --2- 172.21.15.26:0/1064986650 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec142d90 0x7f29ec06a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f268f700 1 --2- 172.21.15.26:0/1064986650 >> v2:172.21.15.190:3300/0 conn(0x7f29ec143160 0x7f29ec0c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f268f700 1 -- 172.21.15.26:0/1064986650 >> 172.21.15.26:0/1064986650 conn(0x7f29ec0ce4d0 msgr2=0x7f29ec0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f268f700 1 -- 172.21.15.26:0/1064986650 shutdown_connections 2023-09-28T00:15:32.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.529+0000 7f29f268f700 1 -- 172.21.15.26:0/1064986650 wait complete. 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.530+0000 7f29f268f700 1 Processor -- start 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29f268f700 1 -- start start 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29f268f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29ec0c4900 0x7f29ec13f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29f268f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec142d90 0x7f29ec141f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29f268f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec143160 0x7f29ec159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29f268f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec141aa0 con 0x7f29ec142d90 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29f268f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0a9b70 con 0x7f29ec0c4900 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29f268f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec140e90 con 0x7f29ec143160 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec142d90 0x7f29ec141f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29eb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec142d90 0x7f29ec141f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46346/0 (socket says 172.21.15.26:46346) 2023-09-28T00:15:32.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.531+0000 7f29eb7fe700 1 -- 172.21.15.26:0/1111154929 learned_addr learned my addr 172.21.15.26:0/1111154929 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29ebfff700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29ec0c4900 0x7f29ec13f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29f0c2c700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec143160 0x7f29ec159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29eb7fe700 1 -- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec143160 msgr2=0x7f29ec159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29eb7fe700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec143160 0x7f29ec159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29eb7fe700 1 -- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29ec0c4900 msgr2=0x7f29ec13f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29eb7fe700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29ec0c4900 0x7f29ec13f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29eb7fe700 1 -- 172.21.15.26:0/1111154929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009ae0 con 0x7f29ec142d90 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29f0c2c700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec143160 0x7f29ec159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29eb7fe700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec142d90 0x7f29ec141f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29d400c850 tx=0x7f29d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29e3fff700 1 -- 172.21.15.26:0/1111154929 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011600 con 0x7f29ec142d90 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29e3fff700 1 -- 172.21.15.26:0/1111154929 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d4011760 con 0x7f29ec142d90 2023-09-28T00:15:32.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec141170 con 0x7f29ec142d90 2023-09-28T00:15:32.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29e3fff700 1 -- 172.21.15.26:0/1111154929 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011b00 con 0x7f29ec142d90 2023-09-28T00:15:32.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.532+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec141730 con 0x7f29ec142d90 2023-09-28T00:15:32.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.533+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec141c50 con 0x7f29ec142d90 2023-09-28T00:15:32.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.533+0000 7f29e3fff700 1 -- 172.21.15.26:0/1111154929 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f29d40073b0 con 0x7f29ec142d90 2023-09-28T00:15:32.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.534+0000 7f29e3fff700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f29cc067330 0x7f29cc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.534+0000 7f29e3fff700 1 -- 172.21.15.26:0/1111154929 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f29d4084b40 con 0x7f29ec142d90 2023-09-28T00:15:32.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.534+0000 7f29ebfff700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f29cc067330 0x7f29cc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.535+0000 7f29ebfff700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f29cc067330 0x7f29cc0697e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0b2760 tx=0x7f29dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:32.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.538+0000 7f29e3fff700 1 -- 172.21.15.26:0/1111154929 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f29ec141c50 con 0x7f29ec142d90 2023-09-28T00:15:32.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.774+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29ec064050 con 0x7f29ec142d90 2023-09-28T00:15:32.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.775+0000 7f29e3fff700 1 -- 172.21.15.26:0/1111154929 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f29d401e090 con 0x7f29ec142d90 2023-09-28T00:15:32.776 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:32.776 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1101672577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1101672577},{"type":"v1","addr":"172.21.15.190:6836","nonce":1101672577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3243251915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3243251915},{"type":"v1","addr":"172.21.15.26:6834","nonce":3243251915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/501056069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":501056069},{"type":"v1","addr":"172.21.15.26:6835","nonce":501056069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:15:29.372185+0000","modified":"2023-09-28T00:15:32.384937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/3098279304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3098279304},{"type":"v1","addr":"172.21.15.190:6837","nonce":3098279304}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:15:32.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f29cc067330 msgr2=0x7f29cc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f29cc067330 0x7f29cc0697e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0b2760 tx=0x7f29dc008040 comp rx=0 tx=0).stop 2023-09-28T00:15:32.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec142d90 msgr2=0x7f29ec141f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec142d90 0x7f29ec141f30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29d400c850 tx=0x7f29d4008040 comp rx=0 tx=0).stop 2023-09-28T00:15:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 shutdown_connections 2023-09-28T00:15:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f29cc067330 0x7f29cc0697e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f29ec143160 0x7f29ec159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f29ec0c4900 0x7f29ec13f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 --2- 172.21.15.26:0/1111154929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f29ec142d90 0x7f29ec141f30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 >> 172.21.15.26:0/1111154929 conn(0x7f29ec0ce4d0 msgr2=0x7f29ec0c4100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 shutdown_connections 2023-09-28T00:15:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.777+0000 7f29f268f700 1 -- 172.21.15.26:0/1111154929 wait complete. 2023-09-28T00:15:32.779 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-09-28T00:15:32.790 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:32.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.907+0000 7f162563d700 1 Processor -- start 2023-09-28T00:15:32.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.907+0000 7f162563d700 1 -- start start 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.908+0000 7f162563d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1620159740 0x7f162015d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.908+0000 7f162563d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f16200695e0 0x7f162006a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.908+0000 7f162563d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1620069ef0 con 0x7f16200ca6b0 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.908+0000 7f162563d700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f162015d8e0 con 0x7f16200695e0 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.908+0000 7f162563d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162015dbc0 con 0x7f1620159740 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.908+0000 7f161f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f16200695e0 0x7f162006a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.908+0000 7f161e7fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f16200ca6b0 0x7f1620068ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43856/0 (socket says 172.21.15.26:43856) 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.908+0000 7f161e7fc700 1 -- 172.21.15.26:0/319025675 learned_addr learned my addr 172.21.15.26:0/319025675 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161effd700 1 --2- 172.21.15.26:0/319025675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1620159740 0x7f162015d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161f7fe700 1 -- 172.21.15.26:0/319025675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1620159740 msgr2=0x7f162015d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161f7fe700 1 --2- 172.21.15.26:0/319025675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1620159740 0x7f162015d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161f7fe700 1 -- 172.21.15.26:0/319025675 >> v1:172.21.15.26:6789/0 conn(0x7f16200ca6b0 legacy=0x7f1620068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161dffb700 1 -- 172.21.15.26:0/319025675 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404290401 0 0) 0x7f1620069ef0 con 0x7f16200ca6b0 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161f7fe700 1 -- 172.21.15.26:0/319025675 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162015dea0 con 0x7f16200695e0 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161effd700 1 --2- 172.21.15.26:0/319025675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1620159740 0x7f162015d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161f7fe700 1 --2- 172.21.15.26:0/319025675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16200695e0 0x7f162006a380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16100098e0 tx=0x7f16100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37aa18b0a1ce7290 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161dffb700 1 -- 172.21.15.26:0/319025675 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610009e80 con 0x7f16200695e0 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161dffb700 1 -- 172.21.15.26:0/319025675 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000b860 con 0x7f16200695e0 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f161dffb700 1 -- 172.21.15.26:0/319025675 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000bbe0 con 0x7f16200695e0 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f162563d700 1 -- 172.21.15.26:0/319025675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16200695e0 msgr2=0x7f162006a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.909+0000 7f162563d700 1 --2- 172.21.15.26:0/319025675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16200695e0 0x7f162006a380 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16100098e0 tx=0x7f16100091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.910+0000 7f162563d700 1 -- 172.21.15.26:0/319025675 shutdown_connections 2023-09-28T00:15:32.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.910+0000 7f162563d700 1 --2- 172.21.15.26:0/319025675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f16200695e0 0x7f162006a380 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.910+0000 7f162563d700 1 --2- 172.21.15.26:0/319025675 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1620159740 0x7f162015d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.910+0000 7f162563d700 1 -- 172.21.15.26:0/319025675 >> 172.21.15.26:0/319025675 conn(0x7f16200c9fc0 msgr2=0x7f162006de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:32.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.910+0000 7f162563d700 1 -- 172.21.15.26:0/319025675 shutdown_connections 2023-09-28T00:15:32.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.910+0000 7f162563d700 1 -- 172.21.15.26:0/319025675 wait complete. 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.911+0000 7f162563d700 1 Processor -- start 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.911+0000 7f162563d700 1 -- start start 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f162563d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16200695e0 0x7f16201475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f162563d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16200ca6b0 0x7f1620155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f162563d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1620159740 0x7f16201562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f162563d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200c4a50 con 0x7f1620159740 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f162563d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200c44d0 con 0x7f16200695e0 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f162563d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200c4770 con 0x7f16200ca6b0 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1620159740 0x7f16201562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1620159740 0x7f16201562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46370/0 (socket says 172.21.15.26:46370) 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161f7fe700 1 -- 172.21.15.26:0/791108165 learned_addr learned my addr 172.21.15.26:0/791108165 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161e7fc700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16200ca6b0 0x7f1620155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161effd700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16200695e0 0x7f16201475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161f7fe700 1 -- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16200ca6b0 msgr2=0x7f1620155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161f7fe700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16200ca6b0 0x7f1620155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161f7fe700 1 -- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16200695e0 msgr2=0x7f16201475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161f7fe700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16200695e0 0x7f16201475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161f7fe700 1 -- 172.21.15.26:0/791108165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1610009420 con 0x7f1620159740 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161e7fc700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16200ca6b0 0x7f1620155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161effd700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16200695e0 0x7f16201475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f161f7fe700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1620159740 0x7f16201562a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16200711b0 tx=0x7f1610017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:32.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f1616ffd700 1 -- 172.21.15.26:0/791108165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000bba0 con 0x7f1620159740 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f1616ffd700 1 -- 172.21.15.26:0/791108165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1610011630 con 0x7f1620159740 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16200c3cc0 con 0x7f1620159740 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f1616ffd700 1 -- 172.21.15.26:0/791108165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100119f0 con 0x7f1620159740 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.912+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1620147af0 con 0x7f1620159740 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.913+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162006afe0 con 0x7f1620159740 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.914+0000 7f1616ffd700 1 -- 172.21.15.26:0/791108165 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f161002c3b0 con 0x7f1620159740 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.914+0000 7f1616ffd700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1600067330 0x7f16000697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.914+0000 7f1616ffd700 1 -- 172.21.15.26:0/791108165 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1610086240 con 0x7f1620159740 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.914+0000 7f161effd700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1600067330 0x7f16000697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:32.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.915+0000 7f161effd700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1600067330 0x7f16000697e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16180094d0 tx=0x7f161800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:32.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:32.918+0000 7f1616ffd700 1 -- 172.21.15.26:0/791108165 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1610053140 con 0x7f1620159740 2023-09-28T00:15:33.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.114+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1620064050 con 0x7f1620159740 2023-09-28T00:15:33.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.114+0000 7f1616ffd700 1 -- 172.21.15.26:0/791108165 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f1610056760 con 0x7f1620159740 2023-09-28T00:15:33.116 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:33.116 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:30.373905+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1600067330 msgr2=0x7f16000697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1600067330 0x7f16000697e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f16180094d0 tx=0x7f161800b040 comp rx=0 tx=0).stop 2023-09-28T00:15:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1620159740 msgr2=0x7f16201562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1620159740 0x7f16201562a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16200711b0 tx=0x7f1610017000 comp rx=0 tx=0).stop 2023-09-28T00:15:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 shutdown_connections 2023-09-28T00:15:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1600067330 0x7f16000697e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1620159740 0x7f16201562a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f16200695e0 0x7f16201475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 --2- 172.21.15.26:0/791108165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f16200ca6b0 0x7f1620155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 >> 172.21.15.26:0/791108165 conn(0x7f16200c9fc0 msgr2=0x7f162006a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 shutdown_connections 2023-09-28T00:15:33.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.117+0000 7f162563d700 1 -- 172.21.15.26:0/791108165 wait complete. 2023-09-28T00:15:33.130 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-28T00:15:33.130 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:15:33.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.248+0000 7fd46e99e700 1 Processor -- start 2023-09-28T00:15:33.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.248+0000 7fd46e99e700 1 -- start start 2023-09-28T00:15:33.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd46e99e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 0x7fd4680d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd46e99e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd46815d930 0x7fd4680b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd46e99e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4680b2ad0 con 0x7fd4681591b0 2023-09-28T00:15:33.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd46e99e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4680b4160 con 0x7fd46815d930 2023-09-28T00:15:33.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd46e99e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4680b1f80 con 0x7fd46815d560 2023-09-28T00:15:33.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd46cf3b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd4681591b0 0x7fd468159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43864/0 (socket says 172.21.15.26:43864) 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd46cf3b700 1 -- 172.21.15.26:0/2754788608 learned_addr learned my addr 172.21.15.26:0/2754788608 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd467fff700 1 --2- 172.21.15.26:0/2754788608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 0x7fd4680d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd4677fe700 1 --2- 172.21.15.26:0/2754788608 >> v2:172.21.15.190:3300/0 conn(0x7fd46815d930 0x7fd4680b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.249+0000 7fd466ffd700 1 -- 172.21.15.26:0/2754788608 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387416938 0 0) 0x7fd4680b2ad0 con 0x7fd4681591b0 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd466ffd700 1 -- 172.21.15.26:0/2754788608 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd454003570 con 0x7fd4681591b0 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd467fff700 1 -- 172.21.15.26:0/2754788608 >> v2:172.21.15.190:3300/0 conn(0x7fd46815d930 msgr2=0x7fd4680b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd467fff700 1 --2- 172.21.15.26:0/2754788608 >> v2:172.21.15.190:3300/0 conn(0x7fd46815d930 0x7fd4680b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd467fff700 1 -- 172.21.15.26:0/2754788608 >> v1:172.21.15.26:6789/0 conn(0x7fd4681591b0 legacy=0x7fd468159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd467fff700 1 -- 172.21.15.26:0/2754788608 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4680b2230 con 0x7fd46815d560 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd4677fe700 1 --2- 172.21.15.26:0/2754788608 >> v2:172.21.15.190:3300/0 conn(0x7fd46815d930 0x7fd4680b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd467fff700 1 --2- 172.21.15.26:0/2754788608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 0x7fd4680d0030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098e0 tx=0x7fd4500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4dec89ac9101486 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:33.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd466ffd700 1 -- 172.21.15.26:0/2754788608 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450011630 con 0x7fd46815d560 2023-09-28T00:15:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd466ffd700 1 -- 172.21.15.26:0/2754788608 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd450011790 con 0x7fd46815d560 2023-09-28T00:15:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.250+0000 7fd466ffd700 1 -- 172.21.15.26:0/2754788608 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450011b10 con 0x7fd46815d560 2023-09-28T00:15:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.251+0000 7fd46e99e700 1 -- 172.21.15.26:0/2754788608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 msgr2=0x7fd4680d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.251+0000 7fd46e99e700 1 --2- 172.21.15.26:0/2754788608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 0x7fd4680d0030 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098e0 tx=0x7fd4500091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.251+0000 7fd46e99e700 1 -- 172.21.15.26:0/2754788608 shutdown_connections 2023-09-28T00:15:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.251+0000 7fd46e99e700 1 --2- 172.21.15.26:0/2754788608 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 0x7fd4680d0030 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.251+0000 7fd46e99e700 1 --2- 172.21.15.26:0/2754788608 >> v2:172.21.15.190:3300/0 conn(0x7fd46815d930 0x7fd4680b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.251+0000 7fd46e99e700 1 -- 172.21.15.26:0/2754788608 >> 172.21.15.26:0/2754788608 conn(0x7fd4680d1180 msgr2=0x7fd468069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:33.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.251+0000 7fd46e99e700 1 -- 172.21.15.26:0/2754788608 shutdown_connections 2023-09-28T00:15:33.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.251+0000 7fd46e99e700 1 -- 172.21.15.26:0/2754788608 wait complete. 2023-09-28T00:15:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.252+0000 7fd46e99e700 1 Processor -- start 2023-09-28T00:15:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.252+0000 7fd46e99e700 1 -- start start 2023-09-28T00:15:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd46e99e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4681591b0 0x7fd46815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd46e99e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 0x7fd468168d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd46e99e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46815d930 0x7fd4681577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd46e99e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46815c420 con 0x7fd4681591b0 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd46e99e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46815c700 con 0x7fd46815d930 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd46e99e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46815c9e0 con 0x7fd46815d560 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd467fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4681591b0 0x7fd46815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd467fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4681591b0 0x7fd46815bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46376/0 (socket says 172.21.15.26:46376) 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd467fff700 1 -- 172.21.15.26:0/3087673115 learned_addr learned my addr 172.21.15.26:0/3087673115 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd4677fe700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 0x7fd468168d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd46cf3b700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46815d930 0x7fd4681577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd467fff700 1 -- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 msgr2=0x7fd468168d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd467fff700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 0x7fd468168d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd467fff700 1 -- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46815d930 msgr2=0x7fd4681577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd467fff700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46815d930 0x7fd4681577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd467fff700 1 -- 172.21.15.26:0/3087673115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd458009420 con 0x7fd4681591b0 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd467fff700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4681591b0 0x7fd46815bb20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4680b20c0 tx=0x7fd450017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd45ffff700 1 -- 172.21.15.26:0/3087673115 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd450011900 con 0x7fd4681591b0 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd450009420 con 0x7fd4681591b0 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd45ffff700 1 -- 172.21.15.26:0/3087673115 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd450011a60 con 0x7fd4681591b0 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd45ffff700 1 -- 172.21.15.26:0/3087673115 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45001a680 con 0x7fd4681591b0 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.253+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46815cfa0 con 0x7fd4681591b0 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.254+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd468064050 con 0x7fd4681591b0 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.255+0000 7fd45ffff700 1 -- 172.21.15.26:0/3087673115 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd45001aa70 con 0x7fd4681591b0 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.255+0000 7fd45ffff700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd448067330 0x7fd4480697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.255+0000 7fd45ffff700 1 -- 172.21.15.26:0/3087673115 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd4500866e0 con 0x7fd4681591b0 2023-09-28T00:15:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.256+0000 7fd4677fe700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd448067330 0x7fd4480697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.256+0000 7fd4677fe700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd448067330 0x7fd4480697e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd4680b1cb0 tx=0x7fd4580091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:33.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.260+0000 7fd45ffff700 1 -- 172.21.15.26:0/3087673115 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd4500535e0 con 0x7fd4681591b0 2023-09-28T00:15:33.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.452+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd46815c870 con 0x7fd448067330 2023-09-28T00:15:33.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.461+0000 7fd45ffff700 1 -- 172.21.15.26:0/3087673115 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284761 (secure 0 0 0) 0x7fd46815c870 con 0x7fd448067330 2023-09-28T00:15:33.466 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd448067330 msgr2=0x7fd4480697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd448067330 0x7fd4480697e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd4680b1cb0 tx=0x7fd4580091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4681591b0 msgr2=0x7fd46815bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4681591b0 0x7fd46815bb20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd4680b20c0 tx=0x7fd450017000 comp rx=0 tx=0).stop 2023-09-28T00:15:33.468 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 shutdown_connections 2023-09-28T00:15:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd448067330 0x7fd4480697e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46815d930 0x7fd4681577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4681591b0 0x7fd46815bb20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 --2- 172.21.15.26:0/3087673115 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46815d560 0x7fd468168d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 >> 172.21.15.26:0/3087673115 conn(0x7fd4680d1180 msgr2=0x7fd4680b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 shutdown_connections 2023-09-28T00:15:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.465+0000 7fd46e99e700 1 -- 172.21.15.26:0/3087673115 wait complete. 2023-09-28T00:15:33.469 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:15:33.478 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-09-28T00:15:31.667921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66184,"kb_used_data":3080,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":754908536,"statfs":{"total":773094113280,"available":773026340864,"internally_reserved":0,"allocated":3153920,"data_stored":1876849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,6,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001109"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392083+0000","last_change":"2023-09-28T00:15:29.392083+0000","last_active":"2023-09-28T00:15:29.392083+0000","last_peered":"2023-09-28T00:15:29.392083+0000","last_clean":"2023-09-28T00:15:29.392083+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:15:29.392083+0000","last_undegraded":"2023-09-28T00:15:29.392083+0000","last_fullsized":"2023-09-28T00:15:29.392083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:53.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391806+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:15:29.391806+0000","last_peered":"2023-09-28T00:15:29.391806+0000","last_clean":"2023-09-28T00:15:29.391806+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:15:29.391806+0000","last_undegraded":"2023-09-28T00:15:29.391806+0000","last_fullsized":"2023-09-28T00:15:29.391806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404174+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:15:29.404174+0000","last_peered":"2023-09-28T00:15:29.404174+0000","last_clean":"2023-09-28T00:15:29.404174+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:15:29.404174+0000","last_undegraded":"2023-09-28T00:15:29.404174+0000","last_fullsized":"2023-09-28T00:15:29.404174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:31:15.779086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394940+0000","last_change":"2023-09-28T00:15:29.387338+0000","last_active":"2023-09-28T00:15:29.394940+0000","last_peered":"2023-09-28T00:15:29.394940+0000","last_clean":"2023-09-28T00:15:29.394940+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:15:29.394940+0000","last_undegraded":"2023-09-28T00:15:29.394940+0000","last_fullsized":"2023-09-28T00:15:29.394940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:11.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398727+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:15:29.398727+0000","last_peered":"2023-09-28T00:15:29.398727+0000","last_clean":"2023-09-28T00:15:29.398727+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:15:29.398727+0000","last_undegraded":"2023-09-28T00:15:29.398727+0000","last_fullsized":"2023-09-28T00:15:29.398727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403262+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:15:29.403262+0000","last_peered":"2023-09-28T00:15:29.403262+0000","last_clean":"2023-09-28T00:15:29.403262+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:15:29.403262+0000","last_undegraded":"2023-09-28T00:15:29.403262+0000","last_fullsized":"2023-09-28T00:15:29.403262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:10.975572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386225+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:15:29.386225+0000","last_peered":"2023-09-28T00:15:29.386225+0000","last_clean":"2023-09-28T00:15:29.386225+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:15:29.386225+0000","last_undegraded":"2023-09-28T00:15:29.386225+0000","last_fullsized":"2023-09-28T00:15:29.386225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399845+0000","last_change":"2023-09-28T00:15:29.398742+0000","last_active":"2023-09-28T00:15:29.399845+0000","last_peered":"2023-09-28T00:15:29.399845+0000","last_clean":"2023-09-28T00:15:29.399845+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:15:29.399845+0000","last_undegraded":"2023-09-28T00:15:29.399845+0000","last_fullsized":"2023-09-28T00:15:29.399845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.401666+0000","last_change":"2023-09-28T00:15:29.401666+0000","last_active":"2023-09-28T00:15:29.401666+0000","last_peered":"2023-09-28T00:15:29.401666+0000","last_clean":"2023-09-28T00:15:29.401666+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:15:29.401666+0000","last_undegraded":"2023-09-28T00:15:29.401666+0000","last_fullsized":"2023-09-28T00:15:29.401666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394457+0000","last_change":"2023-09-28T00:15:29.388253+0000","last_active":"2023-09-28T00:15:29.394457+0000","last_peered":"2023-09-28T00:15:29.394457+0000","last_clean":"2023-09-28T00:15:29.394457+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:15:29.394457+0000","last_undegraded":"2023-09-28T00:15:29.394457+0000","last_fullsized":"2023-09-28T00:15:29.394457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397977+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:15:29.397977+0000","last_peered":"2023-09-28T00:15:29.397977+0000","last_clean":"2023-09-28T00:15:29.397977+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:15:29.397977+0000","last_undegraded":"2023-09-28T00:15:29.397977+0000","last_fullsized":"2023-09-28T00:15:29.397977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399521+0000","last_change":"2023-09-28T00:15:29.399521+0000","last_active":"2023-09-28T00:15:29.399521+0000","last_peered":"2023-09-28T00:15:29.399521+0000","last_clean":"2023-09-28T00:15:29.399521+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:15:29.399521+0000","last_undegraded":"2023-09-28T00:15:29.399521+0000","last_fullsized":"2023-09-28T00:15:29.399521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:38.462117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392028+0000","last_change":"2023-09-28T00:15:29.392028+0000","last_active":"2023-09-28T00:15:29.392028+0000","last_peered":"2023-09-28T00:15:29.392028+0000","last_clean":"2023-09-28T00:15:29.392028+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:15:29.392028+0000","last_undegraded":"2023-09-28T00:15:29.392028+0000","last_fullsized":"2023-09-28T00:15:29.392028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397374+0000","last_change":"2023-09-28T00:15:29.394175+0000","last_active":"2023-09-28T00:15:29.397374+0000","last_peered":"2023-09-28T00:15:29.397374+0000","last_clean":"2023-09-28T00:15:29.397374+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:15:29.397374+0000","last_undegraded":"2023-09-28T00:15:29.397374+0000","last_fullsized":"2023-09-28T00:15:29.397374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391309+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:15:29.391309+0000","last_peered":"2023-09-28T00:15:29.391309+0000","last_clean":"2023-09-28T00:15:29.391309+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:15:29.391309+0000","last_undegraded":"2023-09-28T00:15:29.391309+0000","last_fullsized":"2023-09-28T00:15:29.391309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398296+0000","last_change":"2023-09-28T00:15:29.397273+0000","last_active":"2023-09-28T00:15:29.398296+0000","last_peered":"2023-09-28T00:15:29.398296+0000","last_clean":"2023-09-28T00:15:29.398296+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:15:29.398296+0000","last_undegraded":"2023-09-28T00:15:29.398296+0000","last_fullsized":"2023-09-28T00:15:29.398296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.401695+0000","last_change":"2023-09-28T00:15:29.401695+0000","last_active":"2023-09-28T00:15:29.401695+0000","last_peered":"2023-09-28T00:15:29.401695+0000","last_clean":"2023-09-28T00:15:29.401695+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:15:29.401695+0000","last_undegraded":"2023-09-28T00:15:29.401695+0000","last_fullsized":"2023-09-28T00:15:29.401695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400097+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:15:29.400097+0000","last_peered":"2023-09-28T00:15:29.400097+0000","last_clean":"2023-09-28T00:15:29.400097+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:15:29.400097+0000","last_undegraded":"2023-09-28T00:15:29.400097+0000","last_fullsized":"2023-09-28T00:15:29.400097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386237+0000","last_change":"2023-09-28T00:15:29.386237+0000","last_active":"2023-09-28T00:15:29.386237+0000","last_peered":"2023-09-28T00:15:29.386237+0000","last_clean":"2023-09-28T00:15:29.386237+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:15:29.386237+0000","last_undegraded":"2023-09-28T00:15:29.386237+0000","last_fullsized":"2023-09-28T00:15:29.386237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403381+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:15:29.403381+0000","last_peered":"2023-09-28T00:15:29.403381+0000","last_clean":"2023-09-28T00:15:29.403381+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:15:29.403381+0000","last_undegraded":"2023-09-28T00:15:29.403381+0000","last_fullsized":"2023-09-28T00:15:29.403381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:49:33.646923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392231+0000","last_change":"2023-09-28T00:15:29.392231+0000","last_active":"2023-09-28T00:15:29.392231+0000","last_peered":"2023-09-28T00:15:29.392231+0000","last_clean":"2023-09-28T00:15:29.392231+0000","last_became_active":"2023-09-28T00:15:29.391855+0000","last_became_peered":"2023-09-28T00:15:29.391855+0000","last_unstale":"2023-09-28T00:15:29.392231+0000","last_undegraded":"2023-09-28T00:15:29.392231+0000","last_fullsized":"2023-09-28T00:15:29.392231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394242+0000","last_change":"2023-09-28T00:15:29.394242+0000","last_active":"2023-09-28T00:15:29.394242+0000","last_peered":"2023-09-28T00:15:29.394242+0000","last_clean":"2023-09-28T00:15:29.394242+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:15:29.394242+0000","last_undegraded":"2023-09-28T00:15:29.394242+0000","last_fullsized":"2023-09-28T00:15:29.394242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.389082+0000","last_change":"2023-09-28T00:15:29.389082+0000","last_active":"2023-09-28T00:15:29.389082+0000","last_peered":"2023-09-28T00:15:29.389082+0000","last_clean":"2023-09-28T00:15:29.389082+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:15:29.389082+0000","last_undegraded":"2023-09-28T00:15:29.389082+0000","last_fullsized":"2023-09-28T00:15:29.389082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392532+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:15:29.392532+0000","last_peered":"2023-09-28T00:15:29.392532+0000","last_clean":"2023-09-28T00:15:29.392532+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:15:29.392532+0000","last_undegraded":"2023-09-28T00:15:29.392532+0000","last_fullsized":"2023-09-28T00:15:29.392532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392586+0000","last_change":"2023-09-28T00:15:29.392586+0000","last_active":"2023-09-28T00:15:29.392586+0000","last_peered":"2023-09-28T00:15:29.392586+0000","last_clean":"2023-09-28T00:15:29.392586+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:15:29.392586+0000","last_undegraded":"2023-09-28T00:15:29.392586+0000","last_fullsized":"2023-09-28T00:15:29.392586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:16:11.243076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.384837+0000","last_change":"2023-09-28T00:15:29.384837+0000","last_active":"2023-09-28T00:15:29.384837+0000","last_peered":"2023-09-28T00:15:29.384837+0000","last_clean":"2023-09-28T00:15:29.384837+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:15:29.384837+0000","last_undegraded":"2023-09-28T00:15:29.384837+0000","last_fullsized":"2023-09-28T00:15:29.384837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:49:32.973094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398577+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:15:29.398577+0000","last_peered":"2023-09-28T00:15:29.398577+0000","last_clean":"2023-09-28T00:15:29.398577+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:15:29.398577+0000","last_undegraded":"2023-09-28T00:15:29.398577+0000","last_fullsized":"2023-09-28T00:15:29.398577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399602+0000","last_change":"2023-09-28T00:15:28.982899+0000","last_active":"2023-09-28T00:15:29.399602+0000","last_peered":"2023-09-28T00:15:29.399602+0000","last_clean":"2023-09-28T00:15:29.399602+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:15:29.399602+0000","last_undegraded":"2023-09-28T00:15:29.399602+0000","last_fullsized":"2023-09-28T00:15:29.399602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.383398+0000","last_change":"2023-09-28T00:15:29.383398+0000","last_active":"2023-09-28T00:15:29.383398+0000","last_peered":"2023-09-28T00:15:29.383398+0000","last_clean":"2023-09-28T00:15:29.383398+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:15:29.383398+0000","last_undegraded":"2023-09-28T00:15:29.383398+0000","last_fullsized":"2023-09-28T00:15:29.383398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.986263+0000","last_change":"2023-09-28T00:15:28.984308+0000","last_active":"2023-09-28T00:15:28.986263+0000","last_peered":"2023-09-28T00:15:28.986263+0000","last_clean":"2023-09-28T00:15:28.986263+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:15:28.986263+0000","last_undegraded":"2023-09-28T00:15:28.986263+0000","last_fullsized":"2023-09-28T00:15:28.986263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399205+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:15:29.399205+0000","last_peered":"2023-09-28T00:15:29.399205+0000","last_clean":"2023-09-28T00:15:29.399205+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:15:29.399205+0000","last_undegraded":"2023-09-28T00:15:29.399205+0000","last_fullsized":"2023-09-28T00:15:29.399205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.987965+0000","last_change":"2023-09-28T00:15:28.986600+0000","last_active":"2023-09-28T00:15:28.987965+0000","last_peered":"2023-09-28T00:15:28.987965+0000","last_clean":"2023-09-28T00:15:28.987965+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:15:28.987965+0000","last_undegraded":"2023-09-28T00:15:28.987965+0000","last_fullsized":"2023-09-28T00:15:28.987965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397007+0000","last_change":"2023-09-28T00:15:29.391209+0000","last_active":"2023-09-28T00:15:29.397007+0000","last_peered":"2023-09-28T00:15:29.397007+0000","last_clean":"2023-09-28T00:15:29.397007+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:15:29.397007+0000","last_undegraded":"2023-09-28T00:15:29.397007+0000","last_fullsized":"2023-09-28T00:15:29.397007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.991009+0000","last_change":"2023-09-28T00:15:28.990492+0000","last_active":"2023-09-28T00:15:28.991009+0000","last_peered":"2023-09-28T00:15:28.991009+0000","last_clean":"2023-09-28T00:15:28.991009+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:15:28.991009+0000","last_undegraded":"2023-09-28T00:15:28.991009+0000","last_fullsized":"2023-09-28T00:15:28.991009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.381022+0000","last_change":"2023-09-28T00:15:29.381022+0000","last_active":"2023-09-28T00:15:29.381022+0000","last_peered":"2023-09-28T00:15:29.381022+0000","last_clean":"2023-09-28T00:15:29.381022+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:15:29.381022+0000","last_undegraded":"2023-09-28T00:15:29.381022+0000","last_fullsized":"2023-09-28T00:15:29.381022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378888+0000","last_change":"2023-09-28T00:15:28.989043+0000","last_active":"2023-09-28T00:15:29.378888+0000","last_peered":"2023-09-28T00:15:29.378888+0000","last_clean":"2023-09-28T00:15:29.378888+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:15:29.378888+0000","last_undegraded":"2023-09-28T00:15:29.378888+0000","last_fullsized":"2023-09-28T00:15:29.378888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388831+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:15:29.388831+0000","last_peered":"2023-09-28T00:15:29.388831+0000","last_clean":"2023-09-28T00:15:29.388831+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:15:29.388831+0000","last_undegraded":"2023-09-28T00:15:29.388831+0000","last_fullsized":"2023-09-28T00:15:29.388831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396368+0000","last_change":"2023-09-28T00:15:28.981865+0000","last_active":"2023-09-28T00:15:29.396368+0000","last_peered":"2023-09-28T00:15:29.396368+0000","last_clean":"2023-09-28T00:15:29.396368+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:15:29.396368+0000","last_undegraded":"2023-09-28T00:15:29.396368+0000","last_fullsized":"2023-09-28T00:15:29.396368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.389604+0000","last_change":"2023-09-28T00:15:29.389604+0000","last_active":"2023-09-28T00:15:29.389604+0000","last_peered":"2023-09-28T00:15:29.389604+0000","last_clean":"2023-09-28T00:15:29.389604+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:15:29.389604+0000","last_undegraded":"2023-09-28T00:15:29.389604+0000","last_fullsized":"2023-09-28T00:15:29.389604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.405038+0000","last_change":"2023-09-28T00:15:28.979093+0000","last_active":"2023-09-28T00:15:29.405038+0000","last_peered":"2023-09-28T00:15:29.405038+0000","last_clean":"2023-09-28T00:15:29.405038+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:15:29.405038+0000","last_undegraded":"2023-09-28T00:15:29.405038+0000","last_fullsized":"2023-09-28T00:15:29.405038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404103+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:15:29.404103+0000","last_peered":"2023-09-28T00:15:29.404103+0000","last_clean":"2023-09-28T00:15:29.404103+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:15:29.404103+0000","last_undegraded":"2023-09-28T00:15:29.404103+0000","last_fullsized":"2023-09-28T00:15:29.404103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:59:40.497846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402701+0000","last_change":"2023-09-28T00:15:28.985348+0000","last_active":"2023-09-28T00:15:29.402701+0000","last_peered":"2023-09-28T00:15:29.402701+0000","last_clean":"2023-09-28T00:15:29.402701+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:15:29.402701+0000","last_undegraded":"2023-09-28T00:15:29.402701+0000","last_fullsized":"2023-09-28T00:15:29.402701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.383322+0000","last_change":"2023-09-28T00:15:29.383322+0000","last_active":"2023-09-28T00:15:29.383322+0000","last_peered":"2023-09-28T00:15:29.383322+0000","last_clean":"2023-09-28T00:15:29.383322+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:15:29.383322+0000","last_undegraded":"2023-09-28T00:15:29.383322+0000","last_fullsized":"2023-09-28T00:15:29.383322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.988695+0000","last_change":"2023-09-28T00:15:28.987818+0000","last_active":"2023-09-28T00:15:28.988695+0000","last_peered":"2023-09-28T00:15:28.988695+0000","last_clean":"2023-09-28T00:15:28.988695+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:15:28.988695+0000","last_undegraded":"2023-09-28T00:15:28.988695+0000","last_fullsized":"2023-09-28T00:15:28.988695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397462+0000","last_change":"2023-09-28T00:15:29.395546+0000","last_active":"2023-09-28T00:15:29.397462+0000","last_peered":"2023-09-28T00:15:29.397462+0000","last_clean":"2023-09-28T00:15:29.397462+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:15:29.397462+0000","last_undegraded":"2023-09-28T00:15:29.397462+0000","last_fullsized":"2023-09-28T00:15:29.397462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.988325+0000","last_change":"2023-09-28T00:15:28.985438+0000","last_active":"2023-09-28T00:15:28.988325+0000","last_peered":"2023-09-28T00:15:28.988325+0000","last_clean":"2023-09-28T00:15:28.988325+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:15:28.988325+0000","last_undegraded":"2023-09-28T00:15:28.988325+0000","last_fullsized":"2023-09-28T00:15:28.988325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399423+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:15:29.399423+0000","last_peered":"2023-09-28T00:15:29.399423+0000","last_clean":"2023-09-28T00:15:29.399423+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:15:29.399423+0000","last_undegraded":"2023-09-28T00:15:29.399423+0000","last_fullsized":"2023-09-28T00:15:29.399423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403755+0000","last_change":"2023-09-28T00:15:28.983275+0000","last_active":"2023-09-28T00:15:29.403755+0000","last_peered":"2023-09-28T00:15:29.403755+0000","last_clean":"2023-09-28T00:15:29.403755+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:15:29.403755+0000","last_undegraded":"2023-09-28T00:15:29.403755+0000","last_fullsized":"2023-09-28T00:15:29.403755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:10:17.162300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393952+0000","last_change":"2023-09-28T00:15:29.393952+0000","last_active":"2023-09-28T00:15:29.393952+0000","last_peered":"2023-09-28T00:15:29.393952+0000","last_clean":"2023-09-28T00:15:29.393952+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:15:29.393952+0000","last_undegraded":"2023-09-28T00:15:29.393952+0000","last_fullsized":"2023-09-28T00:15:29.393952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.382975+0000","last_change":"2023-09-28T00:15:28.986391+0000","last_active":"2023-09-28T00:15:29.382975+0000","last_peered":"2023-09-28T00:15:29.382975+0000","last_clean":"2023-09-28T00:15:29.382975+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:15:29.382975+0000","last_undegraded":"2023-09-28T00:15:29.382975+0000","last_fullsized":"2023-09-28T00:15:29.382975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396755+0000","last_change":"2023-09-28T00:15:29.393474+0000","last_active":"2023-09-28T00:15:29.396755+0000","last_peered":"2023-09-28T00:15:29.396755+0000","last_clean":"2023-09-28T00:15:29.396755+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:15:29.396755+0000","last_undegraded":"2023-09-28T00:15:29.396755+0000","last_fullsized":"2023-09-28T00:15:29.396755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395391+0000","last_change":"2023-09-28T00:15:28.986082+0000","last_active":"2023-09-28T00:15:29.395391+0000","last_peered":"2023-09-28T00:15:29.395391+0000","last_clean":"2023-09-28T00:15:29.395391+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:15:29.395391+0000","last_undegraded":"2023-09-28T00:15:29.395391+0000","last_fullsized":"2023-09-28T00:15:29.395391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:16.392360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397610+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:15:29.397610+0000","last_peered":"2023-09-28T00:15:29.397610+0000","last_clean":"2023-09-28T00:15:29.397610+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:15:29.397610+0000","last_undegraded":"2023-09-28T00:15:29.397610+0000","last_fullsized":"2023-09-28T00:15:29.397610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:11:37.490848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379384+0000","last_change":"2023-09-28T00:15:28.982433+0000","last_active":"2023-09-28T00:15:29.379384+0000","last_peered":"2023-09-28T00:15:29.379384+0000","last_clean":"2023-09-28T00:15:29.379384+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:15:29.379384+0000","last_undegraded":"2023-09-28T00:15:29.379384+0000","last_fullsized":"2023-09-28T00:15:29.379384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:37:52.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395572+0000","last_change":"2023-09-28T00:15:29.388766+0000","last_active":"2023-09-28T00:15:29.395572+0000","last_peered":"2023-09-28T00:15:29.395572+0000","last_clean":"2023-09-28T00:15:29.395572+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:15:29.395572+0000","last_undegraded":"2023-09-28T00:15:29.395572+0000","last_fullsized":"2023-09-28T00:15:29.395572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.381202+0000","last_change":"2023-09-28T00:15:28.984089+0000","last_active":"2023-09-28T00:15:29.381202+0000","last_peered":"2023-09-28T00:15:29.381202+0000","last_clean":"2023-09-28T00:15:29.381202+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:15:29.381202+0000","last_undegraded":"2023-09-28T00:15:29.381202+0000","last_fullsized":"2023-09-28T00:15:29.381202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386850+0000","last_change":"2023-09-28T00:15:29.386850+0000","last_active":"2023-09-28T00:15:29.386850+0000","last_peered":"2023-09-28T00:15:29.386850+0000","last_clean":"2023-09-28T00:15:29.386850+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:15:29.386850+0000","last_undegraded":"2023-09-28T00:15:29.386850+0000","last_fullsized":"2023-09-28T00:15:29.386850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402181+0000","last_change":"2023-09-28T00:15:28.986069+0000","last_active":"2023-09-28T00:15:29.402181+0000","last_peered":"2023-09-28T00:15:29.402181+0000","last_clean":"2023-09-28T00:15:29.402181+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:15:29.402181+0000","last_undegraded":"2023-09-28T00:15:29.402181+0000","last_fullsized":"2023-09-28T00:15:29.402181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397756+0000","last_change":"2023-09-28T00:15:29.393182+0000","last_active":"2023-09-28T00:15:29.397756+0000","last_peered":"2023-09-28T00:15:29.397756+0000","last_clean":"2023-09-28T00:15:29.397756+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:15:29.397756+0000","last_undegraded":"2023-09-28T00:15:29.397756+0000","last_fullsized":"2023-09-28T00:15:29.397756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385144+0000","last_change":"2023-09-28T00:15:28.985291+0000","last_active":"2023-09-28T00:15:29.385144+0000","last_peered":"2023-09-28T00:15:29.385144+0000","last_clean":"2023-09-28T00:15:29.385144+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:15:29.385144+0000","last_undegraded":"2023-09-28T00:15:29.385144+0000","last_fullsized":"2023-09-28T00:15:29.385144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404083+0000","last_change":"2023-09-28T00:15:29.400083+0000","last_active":"2023-09-28T00:15:29.404083+0000","last_peered":"2023-09-28T00:15:29.404083+0000","last_clean":"2023-09-28T00:15:29.404083+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:15:29.404083+0000","last_undegraded":"2023-09-28T00:15:29.404083+0000","last_fullsized":"2023-09-28T00:15:29.404083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385946+0000","last_change":"2023-09-28T00:15:28.980715+0000","last_active":"2023-09-28T00:15:29.385946+0000","last_peered":"2023-09-28T00:15:29.385946+0000","last_clean":"2023-09-28T00:15:29.385946+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:15:29.385946+0000","last_undegraded":"2023-09-28T00:15:29.385946+0000","last_fullsized":"2023-09-28T00:15:29.385946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400065+0000","last_change":"2023-09-28T00:15:29.397875+0000","last_active":"2023-09-28T00:15:29.400065+0000","last_peered":"2023-09-28T00:15:29.400065+0000","last_clean":"2023-09-28T00:15:29.400065+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:15:29.400065+0000","last_undegraded":"2023-09-28T00:15:29.400065+0000","last_fullsized":"2023-09-28T00:15:29.400065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:35:06.112174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.987946+0000","last_change":"2023-09-28T00:15:28.986410+0000","last_active":"2023-09-28T00:15:28.987946+0000","last_peered":"2023-09-28T00:15:28.987946+0000","last_clean":"2023-09-28T00:15:28.987946+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:15:28.987946+0000","last_undegraded":"2023-09-28T00:15:28.987946+0000","last_fullsized":"2023-09-28T00:15:28.987946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392748+0000","last_change":"2023-09-28T00:15:29.392748+0000","last_active":"2023-09-28T00:15:29.392748+0000","last_peered":"2023-09-28T00:15:29.392748+0000","last_clean":"2023-09-28T00:15:29.392748+0000","last_became_active":"2023-09-28T00:15:29.392336+0000","last_became_peered":"2023-09-28T00:15:29.392336+0000","last_unstale":"2023-09-28T00:15:29.392748+0000","last_undegraded":"2023-09-28T00:15:29.392748+0000","last_fullsized":"2023-09-28T00:15:29.392748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.974649+0000","last_change":"2023-09-28T00:15:24.193273+0000","last_active":"2023-09-28T00:15:28.974649+0000","last_peered":"2023-09-28T00:15:28.974649+0000","last_clean":"2023-09-28T00:15:28.974649+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:15:28.974649+0000","last_undegraded":"2023-09-28T00:15:28.974649+0000","last_fullsized":"2023-09-28T00:15:28.974649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:55:44.401134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379326+0000","last_change":"2023-09-28T00:15:28.986194+0000","last_active":"2023-09-28T00:15:29.379326+0000","last_peered":"2023-09-28T00:15:29.379326+0000","last_clean":"2023-09-28T00:15:29.379326+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:15:29.379326+0000","last_undegraded":"2023-09-28T00:15:29.379326+0000","last_fullsized":"2023-09-28T00:15:29.379326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388604+0000","last_change":"2023-09-28T00:15:29.388604+0000","last_active":"2023-09-28T00:15:29.388604+0000","last_peered":"2023-09-28T00:15:29.388604+0000","last_clean":"2023-09-28T00:15:29.388604+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:15:29.388604+0000","last_undegraded":"2023-09-28T00:15:29.388604+0000","last_fullsized":"2023-09-28T00:15:29.388604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378226+0000","last_change":"2023-09-28T00:15:23.950475+0000","last_active":"2023-09-28T00:15:29.378226+0000","last_peered":"2023-09-28T00:15:29.378226+0000","last_clean":"2023-09-28T00:15:29.378226+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:15:29.378226+0000","last_undegraded":"2023-09-28T00:15:29.378226+0000","last_fullsized":"2023-09-28T00:15:29.378226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386282+0000","last_change":"2023-09-28T00:15:28.984604+0000","last_active":"2023-09-28T00:15:29.386282+0000","last_peered":"2023-09-28T00:15:29.386282+0000","last_clean":"2023-09-28T00:15:29.386282+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:15:29.386282+0000","last_undegraded":"2023-09-28T00:15:29.386282+0000","last_fullsized":"2023-09-28T00:15:29.386282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392616+0000","last_change":"2023-09-28T00:15:29.392616+0000","last_active":"2023-09-28T00:15:29.392616+0000","last_peered":"2023-09-28T00:15:29.392616+0000","last_clean":"2023-09-28T00:15:29.392616+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:15:29.392616+0000","last_undegraded":"2023-09-28T00:15:29.392616+0000","last_fullsized":"2023-09-28T00:15:29.392616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:20:56.060002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.969042+0000","last_change":"2023-09-28T00:15:24.193731+0000","last_active":"2023-09-28T00:15:28.969042+0000","last_peered":"2023-09-28T00:15:28.969042+0000","last_clean":"2023-09-28T00:15:28.969042+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:15:28.969042+0000","last_undegraded":"2023-09-28T00:15:28.969042+0000","last_fullsized":"2023-09-28T00:15:28.969042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:10:07.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.984853+0000","last_change":"2023-09-28T00:15:28.980294+0000","last_active":"2023-09-28T00:15:28.984853+0000","last_peered":"2023-09-28T00:15:28.984853+0000","last_clean":"2023-09-28T00:15:28.984853+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:15:28.984853+0000","last_undegraded":"2023-09-28T00:15:28.984853+0000","last_fullsized":"2023-09-28T00:15:28.984853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388008+0000","last_change":"2023-09-28T00:15:29.388008+0000","last_active":"2023-09-28T00:15:29.388008+0000","last_peered":"2023-09-28T00:15:29.388008+0000","last_clean":"2023-09-28T00:15:29.388008+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:15:29.388008+0000","last_undegraded":"2023-09-28T00:15:29.388008+0000","last_fullsized":"2023-09-28T00:15:29.388008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.377855+0000","last_change":"2023-09-28T00:15:23.950457+0000","last_active":"2023-09-28T00:15:29.377855+0000","last_peered":"2023-09-28T00:15:29.377855+0000","last_clean":"2023-09-28T00:15:29.377855+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:15:29.377855+0000","last_undegraded":"2023-09-28T00:15:29.377855+0000","last_fullsized":"2023-09-28T00:15:29.377855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.970751+0000","last_change":"2023-09-28T00:15:16.995081+0000","last_active":"2023-09-28T00:15:28.970751+0000","last_peered":"2023-09-28T00:15:28.970751+0000","last_clean":"2023-09-28T00:15:28.970751+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:15:28.970751+0000","last_undegraded":"2023-09-28T00:15:28.970751+0000","last_fullsized":"2023-09-28T00:15:28.970751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_clean_scrub_stamp":"2023-09-28T00:15:15.867916+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:37:49.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.986865+0000","last_change":"2023-09-28T00:15:28.985016+0000","last_active":"2023-09-28T00:15:28.986865+0000","last_peered":"2023-09-28T00:15:28.986865+0000","last_clean":"2023-09-28T00:15:28.986865+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:15:28.986865+0000","last_undegraded":"2023-09-28T00:15:28.986865+0000","last_fullsized":"2023-09-28T00:15:28.986865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403095+0000","last_change":"2023-09-28T00:15:29.401863+0000","last_active":"2023-09-28T00:15:29.403095+0000","last_peered":"2023-09-28T00:15:29.403095+0000","last_clean":"2023-09-28T00:15:29.403095+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:15:29.403095+0000","last_undegraded":"2023-09-28T00:15:29.403095+0000","last_fullsized":"2023-09-28T00:15:29.403095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:17.400054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.970857+0000","last_change":"2023-09-28T00:15:23.946737+0000","last_active":"2023-09-28T00:15:28.970857+0000","last_peered":"2023-09-28T00:15:28.970857+0000","last_clean":"2023-09-28T00:15:28.970857+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:15:28.970857+0000","last_undegraded":"2023-09-28T00:15:28.970857+0000","last_fullsized":"2023-09-28T00:15:28.970857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.988359+0000","last_change":"2023-09-28T00:15:28.986464+0000","last_active":"2023-09-28T00:15:28.988359+0000","last_peered":"2023-09-28T00:15:28.988359+0000","last_clean":"2023-09-28T00:15:28.988359+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:15:28.988359+0000","last_undegraded":"2023-09-28T00:15:28.988359+0000","last_fullsized":"2023-09-28T00:15:28.988359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390313+0000","last_change":"2023-09-28T00:15:29.390313+0000","last_active":"2023-09-28T00:15:29.390313+0000","last_peered":"2023-09-28T00:15:29.390313+0000","last_clean":"2023-09-28T00:15:29.390313+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:15:29.390313+0000","last_undegraded":"2023-09-28T00:15:29.390313+0000","last_fullsized":"2023-09-28T00:15:29.390313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.971043+0000","last_change":"2023-09-28T00:15:24.193260+0000","last_active":"2023-09-28T00:15:28.971043+0000","last_peered":"2023-09-28T00:15:28.971043+0000","last_clean":"2023-09-28T00:15:28.971043+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:15:28.971043+0000","last_undegraded":"2023-09-28T00:15:28.971043+0000","last_fullsized":"2023-09-28T00:15:28.971043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.984985+0000","last_change":"2023-09-28T00:15:28.979725+0000","last_active":"2023-09-28T00:15:28.984985+0000","last_peered":"2023-09-28T00:15:28.984985+0000","last_clean":"2023-09-28T00:15:28.984985+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:15:28.984985+0000","last_undegraded":"2023-09-28T00:15:28.984985+0000","last_fullsized":"2023-09-28T00:15:28.984985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398984+0000","last_change":"2023-09-28T00:15:29.398984+0000","last_active":"2023-09-28T00:15:29.398984+0000","last_peered":"2023-09-28T00:15:29.398984+0000","last_clean":"2023-09-28T00:15:29.398984+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:15:29.398984+0000","last_undegraded":"2023-09-28T00:15:29.398984+0000","last_fullsized":"2023-09-28T00:15:29.398984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394909+0000","last_change":"2023-09-28T00:15:28.989236+0000","last_active":"2023-09-28T00:15:29.394909+0000","last_peered":"2023-09-28T00:15:29.394909+0000","last_clean":"2023-09-28T00:15:29.394909+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:15:29.394909+0000","last_undegraded":"2023-09-28T00:15:29.394909+0000","last_fullsized":"2023-09-28T00:15:29.394909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.974926+0000","last_change":"2023-09-28T00:15:23.949425+0000","last_active":"2023-09-28T00:15:28.974926+0000","last_peered":"2023-09-28T00:15:28.974926+0000","last_clean":"2023-09-28T00:15:28.974926+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:15:28.974926+0000","last_undegraded":"2023-09-28T00:15:28.974926+0000","last_fullsized":"2023-09-28T00:15:28.974926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:59:04.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386508+0000","last_change":"2023-09-28T00:15:29.386508+0000","last_active":"2023-09-28T00:15:29.386508+0000","last_peered":"2023-09-28T00:15:29.386508+0000","last_clean":"2023-09-28T00:15:29.386508+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:15:29.386508+0000","last_undegraded":"2023-09-28T00:15:29.386508+0000","last_fullsized":"2023-09-28T00:15:29.386508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385234+0000","last_change":"2023-09-28T00:15:23.949692+0000","last_active":"2023-09-28T00:15:29.385234+0000","last_peered":"2023-09-28T00:15:29.385234+0000","last_clean":"2023-09-28T00:15:29.385234+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:15:29.385234+0000","last_undegraded":"2023-09-28T00:15:29.385234+0000","last_fullsized":"2023-09-28T00:15:29.385234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:48:11.275095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.989159+0000","last_change":"2023-09-28T00:15:28.988077+0000","last_active":"2023-09-28T00:15:28.989159+0000","last_peered":"2023-09-28T00:15:28.989159+0000","last_clean":"2023-09-28T00:15:28.989159+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:15:28.989159+0000","last_undegraded":"2023-09-28T00:15:28.989159+0000","last_fullsized":"2023-09-28T00:15:28.989159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399373+0000","last_change":"2023-09-28T00:15:29.398170+0000","last_active":"2023-09-28T00:15:29.399373+0000","last_peered":"2023-09-28T00:15:29.399373+0000","last_clean":"2023-09-28T00:15:29.399373+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:15:29.399373+0000","last_undegraded":"2023-09-28T00:15:29.399373+0000","last_fullsized":"2023-09-28T00:15:29.399373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:30:23.382889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.389888+0000","last_change":"2023-09-28T00:15:28.987224+0000","last_active":"2023-09-28T00:15:29.389888+0000","last_peered":"2023-09-28T00:15:29.389888+0000","last_clean":"2023-09-28T00:15:29.389888+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:15:29.389888+0000","last_undegraded":"2023-09-28T00:15:29.389888+0000","last_fullsized":"2023-09-28T00:15:29.389888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.383759+0000","last_change":"2023-09-28T00:15:29.383759+0000","last_active":"2023-09-28T00:15:29.383759+0000","last_peered":"2023-09-28T00:15:29.383759+0000","last_clean":"2023-09-28T00:15:29.383759+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:15:29.383759+0000","last_undegraded":"2023-09-28T00:15:29.383759+0000","last_fullsized":"2023-09-28T00:15:29.383759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:06.286162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402275+0000","last_change":"2023-09-28T00:15:28.987633+0000","last_active":"2023-09-28T00:15:29.402275+0000","last_peered":"2023-09-28T00:15:29.402275+0000","last_clean":"2023-09-28T00:15:29.402275+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:15:29.402275+0000","last_undegraded":"2023-09-28T00:15:29.402275+0000","last_fullsized":"2023-09-28T00:15:29.402275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398131+0000","last_change":"2023-09-28T00:15:29.392897+0000","last_active":"2023-09-28T00:15:29.398131+0000","last_peered":"2023-09-28T00:15:29.398131+0000","last_clean":"2023-09-28T00:15:29.398131+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:15:29.398131+0000","last_undegraded":"2023-09-28T00:15:29.398131+0000","last_fullsized":"2023-09-28T00:15:29.398131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403684+0000","last_change":"2023-09-28T00:15:28.987962+0000","last_active":"2023-09-28T00:15:29.403684+0000","last_peered":"2023-09-28T00:15:29.403684+0000","last_clean":"2023-09-28T00:15:29.403684+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:15:29.403684+0000","last_undegraded":"2023-09-28T00:15:29.403684+0000","last_fullsized":"2023-09-28T00:15:29.403684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399076+0000","last_change":"2023-09-28T00:15:29.394598+0000","last_active":"2023-09-28T00:15:29.399076+0000","last_peered":"2023-09-28T00:15:29.399076+0000","last_clean":"2023-09-28T00:15:29.399076+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:15:29.399076+0000","last_undegraded":"2023-09-28T00:15:29.399076+0000","last_fullsized":"2023-09-28T00:15:29.399076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375726+0000","last_change":"2023-09-28T00:15:28.983686+0000","last_active":"2023-09-28T00:15:29.375726+0000","last_peered":"2023-09-28T00:15:29.375726+0000","last_clean":"2023-09-28T00:15:29.375726+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:15:29.375726+0000","last_undegraded":"2023-09-28T00:15:29.375726+0000","last_fullsized":"2023-09-28T00:15:29.375726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.384759+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:15:29.384759+0000","last_peered":"2023-09-28T00:15:29.384759+0000","last_clean":"2023-09-28T00:15:29.384759+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:15:29.384759+0000","last_undegraded":"2023-09-28T00:15:29.384759+0000","last_fullsized":"2023-09-28T00:15:29.384759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402470+0000","last_change":"2023-09-28T00:15:28.985280+0000","last_active":"2023-09-28T00:15:29.402470+0000","last_peered":"2023-09-28T00:15:29.402470+0000","last_clean":"2023-09-28T00:15:29.402470+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:15:29.402470+0000","last_undegraded":"2023-09-28T00:15:29.402470+0000","last_fullsized":"2023-09-28T00:15:29.402470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400030+0000","last_change":"2023-09-28T00:15:29.398360+0000","last_active":"2023-09-28T00:15:29.400030+0000","last_peered":"2023-09-28T00:15:29.400030+0000","last_clean":"2023-09-28T00:15:29.400030+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:15:29.400030+0000","last_undegraded":"2023-09-28T00:15:29.400030+0000","last_fullsized":"2023-09-28T00:15:29.400030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:58:13.878285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400854+0000","last_change":"2023-09-28T00:15:29.395080+0000","last_active":"2023-09-28T00:15:29.400854+0000","last_peered":"2023-09-28T00:15:29.400854+0000","last_clean":"2023-09-28T00:15:29.400854+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:15:29.400854+0000","last_undegraded":"2023-09-28T00:15:29.400854+0000","last_fullsized":"2023-09-28T00:15:29.400854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:39.792299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.384589+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:15:29.384589+0000","last_peered":"2023-09-28T00:15:29.384589+0000","last_clean":"2023-09-28T00:15:29.384589+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:15:29.384589+0000","last_undegraded":"2023-09-28T00:15:29.384589+0000","last_fullsized":"2023-09-28T00:15:29.384589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403283+0000","last_change":"2023-09-28T00:15:29.399203+0000","last_active":"2023-09-28T00:15:29.403283+0000","last_peered":"2023-09-28T00:15:29.403283+0000","last_clean":"2023-09-28T00:15:29.403283+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:15:29.403283+0000","last_undegraded":"2023-09-28T00:15:29.403283+0000","last_fullsized":"2023-09-28T00:15:29.403283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:47:48.079491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388644+0000","last_change":"2023-09-28T00:15:29.388644+0000","last_active":"2023-09-28T00:15:29.388644+0000","last_peered":"2023-09-28T00:15:29.388644+0000","last_clean":"2023-09-28T00:15:29.388644+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:15:29.388644+0000","last_undegraded":"2023-09-28T00:15:29.388644+0000","last_fullsized":"2023-09-28T00:15:29.388644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388432+0000","last_change":"2023-09-28T00:15:29.388432+0000","last_active":"2023-09-28T00:15:29.388432+0000","last_peered":"2023-09-28T00:15:29.388432+0000","last_clean":"2023-09-28T00:15:29.388432+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:15:29.388432+0000","last_undegraded":"2023-09-28T00:15:29.388432+0000","last_fullsized":"2023-09-28T00:15:29.388432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7992,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363848,"statfs":{"total":96636764160,"available":96628580352,"internally_reserved":0,"allocated":245760,"data_stored":87121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8048,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363792,"statfs":{"total":96636764160,"available":96628523008,"internally_reserved":0,"allocated":237568,"data_stored":86497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9080,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362760,"statfs":{"total":96636764160,"available":96627466240,"internally_reserved":0,"allocated":835584,"data_stored":677419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,6,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2610000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4400000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9104,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362736,"statfs":{"total":96636764160,"available":96627441664,"internally_reserved":0,"allocated":860160,"data_stored":678617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7844,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94363996,"statfs":{"total":96636764160,"available":96628731904,"internally_reserved":0,"allocated":225280,"data_stored":79381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":86587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":88089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:15:33.484 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:15:33.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.635+0000 7f02f5def700 1 Processor -- start 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.636+0000 7f02f5def700 1 -- start start 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.636+0000 7f02f5def700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f006c8a0 0x7f02f01646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.636+0000 7f02f5def700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f00cce40 con 0x7f02f00c79b0 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.636+0000 7f02f5def700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f00cbf50 con 0x7f02f01571d0 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.636+0000 7f02f5def700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f00cc230 con 0x7f02f006c8a0 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02eeffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f02f00c79b0 0x7f02f006c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43878/0 (socket says 172.21.15.26:43878) 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02eeffd700 1 -- 172.21.15.26:0/3095431542 learned_addr learned my addr 172.21.15.26:0/3095431542 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02effff700 1 --2- 172.21.15.26:0/3095431542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f006c8a0 0x7f02f01646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02ee7fc700 1 -- 172.21.15.26:0/3095431542 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289097708 0 0) 0x7f02f00cce40 con 0x7f02f00c79b0 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02ee7fc700 1 -- 172.21.15.26:0/3095431542 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02d8003570 con 0x7f02f00c79b0 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02ee7fc700 1 -- 172.21.15.26:0/3095431542 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647255756 0 0) 0x7f02f00cbf50 con 0x7f02f01571d0 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02ee7fc700 1 -- 172.21.15.26:0/3095431542 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02f00cce40 con 0x7f02f01571d0 2023-09-28T00:15:33.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02effff700 1 -- 172.21.15.26:0/3095431542 >> v1:172.21.15.190:6789/0 conn(0x7f02f01571d0 legacy=0x7f02f015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02effff700 1 -- 172.21.15.26:0/3095431542 >> v1:172.21.15.26:6789/0 conn(0x7f02f00c79b0 legacy=0x7f02f006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02ee7fc700 1 -- 172.21.15.26:0/3095431542 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 765091947 0 0) 0x7f02d8003570 con 0x7f02f00c79b0 2023-09-28T00:15:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02effff700 1 -- 172.21.15.26:0/3095431542 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f00cc510 con 0x7f02f006c8a0 2023-09-28T00:15:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02effff700 1 --2- 172.21.15.26:0/3095431542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f006c8a0 0x7f02f01646b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009e90 tx=0x7f02e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e94f7faf1f5702a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02ee7fc700 1 -- 172.21.15.26:0/3095431542 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e800e070 con 0x7f02f006c8a0 2023-09-28T00:15:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02ee7fc700 1 -- 172.21.15.26:0/3095431542 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e800b870 con 0x7f02f006c8a0 2023-09-28T00:15:33.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.637+0000 7f02ee7fc700 1 -- 172.21.15.26:0/3095431542 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4001470 con 0x7f02f006c8a0 2023-09-28T00:15:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.638+0000 7f02f5def700 1 -- 172.21.15.26:0/3095431542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f006c8a0 msgr2=0x7f02f01646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.638+0000 7f02f5def700 1 --2- 172.21.15.26:0/3095431542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f006c8a0 0x7f02f01646b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009e90 tx=0x7f02e8009780 comp rx=0 tx=0).stop 2023-09-28T00:15:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.638+0000 7f02f5def700 1 -- 172.21.15.26:0/3095431542 shutdown_connections 2023-09-28T00:15:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.638+0000 7f02f5def700 1 --2- 172.21.15.26:0/3095431542 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f006c8a0 0x7f02f01646b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.638+0000 7f02f5def700 1 -- 172.21.15.26:0/3095431542 >> 172.21.15.26:0/3095431542 conn(0x7f02f006e6a0 msgr2=0x7f02f006eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:33.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.638+0000 7f02f5def700 1 -- 172.21.15.26:0/3095431542 shutdown_connections 2023-09-28T00:15:33.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.638+0000 7f02f5def700 1 -- 172.21.15.26:0/3095431542 wait complete. 2023-09-28T00:15:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.639+0000 7f02f5def700 1 Processor -- start 2023-09-28T00:15:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.639+0000 7f02f5def700 1 -- start start 2023-09-28T00:15:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02f5def700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f006c8a0 0x7f02f015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02f5def700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f00c79b0 0x7f02f014cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02f5def700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f01571d0 0x7f02f0152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02f5def700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f0160250 con 0x7f02f006c8a0 2023-09-28T00:15:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02f5def700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f015f640 con 0x7f02f01571d0 2023-09-28T00:15:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02f5def700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f015f920 con 0x7f02f00c79b0 2023-09-28T00:15:33.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02ef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f006c8a0 0x7f02f015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02ef7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f006c8a0 0x7f02f015ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46382/0 (socket says 172.21.15.26:46382) 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02ef7fe700 1 -- 172.21.15.26:0/625988689 learned_addr learned my addr 172.21.15.26:0/625988689 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02eeffd700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f00c79b0 0x7f02f014cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02effff700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f01571d0 0x7f02f0152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02ef7fe700 1 -- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f00c79b0 msgr2=0x7f02f014cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02ef7fe700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f00c79b0 0x7f02f014cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02ef7fe700 1 -- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f01571d0 msgr2=0x7f02f0152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02ef7fe700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f01571d0 0x7f02f0152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02ef7fe700 1 -- 172.21.15.26:0/625988689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e8009a20 con 0x7f02f006c8a0 2023-09-28T00:15:33.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02eeffd700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f00c79b0 0x7f02f014cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.640+0000 7f02effff700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f01571d0 0x7f02f0152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.641+0000 7f02ef7fe700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f006c8a0 0x7f02f015ee50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c580 tx=0x7f02e0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.641+0000 7f02d77fe700 1 -- 172.21.15.26:0/625988689 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0010510 con 0x7f02f006c8a0 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.641+0000 7f02d77fe700 1 -- 172.21.15.26:0/625988689 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e0010670 con 0x7f02f006c8a0 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.641+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f015fc00 con 0x7f02f006c8a0 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.641+0000 7f02d77fe700 1 -- 172.21.15.26:0/625988689 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0010a30 con 0x7f02f006c8a0 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.641+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f00c5e10 con 0x7f02f006c8a0 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.642+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f015f390 con 0x7f02f006c8a0 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.642+0000 7f02d77fe700 1 -- 172.21.15.26:0/625988689 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f02e001b400 con 0x7f02f006c8a0 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.642+0000 7f02d77fe700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f02dc067330 0x7f02dc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:33.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.643+0000 7f02d77fe700 1 -- 172.21.15.26:0/625988689 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f02e00848d0 con 0x7f02f006c8a0 2023-09-28T00:15:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.643+0000 7f02eeffd700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f02dc067330 0x7f02dc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.643+0000 7f02eeffd700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f02dc067330 0x7f02dc0697e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02f00c4e20 tx=0x7f02e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:33.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.647+0000 7f02d77fe700 1 -- 172.21.15.26:0/625988689 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f02e00517d0 con 0x7f02f006c8a0 2023-09-28T00:15:33.838 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.836+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02f0160390 con 0x7f02dc067330 2023-09-28T00:15:33.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.845+0000 7f02d77fe700 1 -- 172.21.15.26:0/625988689 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284761 (secure 0 0 0) 0x7f02e40070d0 con 0x7f02dc067330 2023-09-28T00:15:33.848 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.847+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f02dc067330 msgr2=0x7f02dc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.847+0000 7f02f5def700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f02dc067330 0x7f02dc0697e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f02f00c4e20 tx=0x7f02e4009040 comp rx=0 tx=0).stop 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.847+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f006c8a0 msgr2=0x7f02f015ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.847+0000 7f02f5def700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f006c8a0 0x7f02f015ee50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02e000c580 tx=0x7f02e0007e10 comp rx=0 tx=0).stop 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.848+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 shutdown_connections 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.848+0000 7f02f5def700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f02dc067330 0x7f02dc0697e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.848+0000 7f02f5def700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f02f01571d0 0x7f02f0152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.848+0000 7f02f5def700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02f006c8a0 0x7f02f015ee50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.848+0000 7f02f5def700 1 --2- 172.21.15.26:0/625988689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f02f00c79b0 0x7f02f014cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:33.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.848+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 >> 172.21.15.26:0/625988689 conn(0x7f02f006e6a0 msgr2=0x7f02f0150f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.848+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 shutdown_connections 2023-09-28T00:15:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:33.848+0000 7f02f5def700 1 -- 172.21.15.26:0/625988689 wait complete. 2023-09-28T00:15:33.852 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:15:33.860 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-09-28T00:15:33.668435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66184,"kb_used_data":3080,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":754908536,"statfs":{"total":773094113280,"available":773026340864,"internally_reserved":0,"allocated":3153920,"data_stored":1876849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,6,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.707720"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392083+0000","last_change":"2023-09-28T00:15:29.392083+0000","last_active":"2023-09-28T00:15:29.392083+0000","last_peered":"2023-09-28T00:15:29.392083+0000","last_clean":"2023-09-28T00:15:29.392083+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:15:29.392083+0000","last_undegraded":"2023-09-28T00:15:29.392083+0000","last_fullsized":"2023-09-28T00:15:29.392083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:53.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391806+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:15:29.391806+0000","last_peered":"2023-09-28T00:15:29.391806+0000","last_clean":"2023-09-28T00:15:29.391806+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:15:29.391806+0000","last_undegraded":"2023-09-28T00:15:29.391806+0000","last_fullsized":"2023-09-28T00:15:29.391806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404174+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:15:29.404174+0000","last_peered":"2023-09-28T00:15:29.404174+0000","last_clean":"2023-09-28T00:15:29.404174+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:15:29.404174+0000","last_undegraded":"2023-09-28T00:15:29.404174+0000","last_fullsized":"2023-09-28T00:15:29.404174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:31:15.779086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394940+0000","last_change":"2023-09-28T00:15:29.387338+0000","last_active":"2023-09-28T00:15:29.394940+0000","last_peered":"2023-09-28T00:15:29.394940+0000","last_clean":"2023-09-28T00:15:29.394940+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:15:29.394940+0000","last_undegraded":"2023-09-28T00:15:29.394940+0000","last_fullsized":"2023-09-28T00:15:29.394940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:11.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398727+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:15:29.398727+0000","last_peered":"2023-09-28T00:15:29.398727+0000","last_clean":"2023-09-28T00:15:29.398727+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:15:29.398727+0000","last_undegraded":"2023-09-28T00:15:29.398727+0000","last_fullsized":"2023-09-28T00:15:29.398727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403262+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:15:29.403262+0000","last_peered":"2023-09-28T00:15:29.403262+0000","last_clean":"2023-09-28T00:15:29.403262+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:15:29.403262+0000","last_undegraded":"2023-09-28T00:15:29.403262+0000","last_fullsized":"2023-09-28T00:15:29.403262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:10.975572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386225+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:15:29.386225+0000","last_peered":"2023-09-28T00:15:29.386225+0000","last_clean":"2023-09-28T00:15:29.386225+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:15:29.386225+0000","last_undegraded":"2023-09-28T00:15:29.386225+0000","last_fullsized":"2023-09-28T00:15:29.386225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399845+0000","last_change":"2023-09-28T00:15:29.398742+0000","last_active":"2023-09-28T00:15:29.399845+0000","last_peered":"2023-09-28T00:15:29.399845+0000","last_clean":"2023-09-28T00:15:29.399845+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:15:29.399845+0000","last_undegraded":"2023-09-28T00:15:29.399845+0000","last_fullsized":"2023-09-28T00:15:29.399845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.401666+0000","last_change":"2023-09-28T00:15:29.401666+0000","last_active":"2023-09-28T00:15:29.401666+0000","last_peered":"2023-09-28T00:15:29.401666+0000","last_clean":"2023-09-28T00:15:29.401666+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:15:29.401666+0000","last_undegraded":"2023-09-28T00:15:29.401666+0000","last_fullsized":"2023-09-28T00:15:29.401666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394457+0000","last_change":"2023-09-28T00:15:29.388253+0000","last_active":"2023-09-28T00:15:29.394457+0000","last_peered":"2023-09-28T00:15:29.394457+0000","last_clean":"2023-09-28T00:15:29.394457+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:15:29.394457+0000","last_undegraded":"2023-09-28T00:15:29.394457+0000","last_fullsized":"2023-09-28T00:15:29.394457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397977+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:15:29.397977+0000","last_peered":"2023-09-28T00:15:29.397977+0000","last_clean":"2023-09-28T00:15:29.397977+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:15:29.397977+0000","last_undegraded":"2023-09-28T00:15:29.397977+0000","last_fullsized":"2023-09-28T00:15:29.397977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399521+0000","last_change":"2023-09-28T00:15:29.399521+0000","last_active":"2023-09-28T00:15:29.399521+0000","last_peered":"2023-09-28T00:15:29.399521+0000","last_clean":"2023-09-28T00:15:29.399521+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:15:29.399521+0000","last_undegraded":"2023-09-28T00:15:29.399521+0000","last_fullsized":"2023-09-28T00:15:29.399521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:38.462117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392028+0000","last_change":"2023-09-28T00:15:29.392028+0000","last_active":"2023-09-28T00:15:29.392028+0000","last_peered":"2023-09-28T00:15:29.392028+0000","last_clean":"2023-09-28T00:15:29.392028+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:15:29.392028+0000","last_undegraded":"2023-09-28T00:15:29.392028+0000","last_fullsized":"2023-09-28T00:15:29.392028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397374+0000","last_change":"2023-09-28T00:15:29.394175+0000","last_active":"2023-09-28T00:15:29.397374+0000","last_peered":"2023-09-28T00:15:29.397374+0000","last_clean":"2023-09-28T00:15:29.397374+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:15:29.397374+0000","last_undegraded":"2023-09-28T00:15:29.397374+0000","last_fullsized":"2023-09-28T00:15:29.397374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391309+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:15:29.391309+0000","last_peered":"2023-09-28T00:15:29.391309+0000","last_clean":"2023-09-28T00:15:29.391309+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:15:29.391309+0000","last_undegraded":"2023-09-28T00:15:29.391309+0000","last_fullsized":"2023-09-28T00:15:29.391309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398296+0000","last_change":"2023-09-28T00:15:29.397273+0000","last_active":"2023-09-28T00:15:29.398296+0000","last_peered":"2023-09-28T00:15:29.398296+0000","last_clean":"2023-09-28T00:15:29.398296+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:15:29.398296+0000","last_undegraded":"2023-09-28T00:15:29.398296+0000","last_fullsized":"2023-09-28T00:15:29.398296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.401695+0000","last_change":"2023-09-28T00:15:29.401695+0000","last_active":"2023-09-28T00:15:29.401695+0000","last_peered":"2023-09-28T00:15:29.401695+0000","last_clean":"2023-09-28T00:15:29.401695+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:15:29.401695+0000","last_undegraded":"2023-09-28T00:15:29.401695+0000","last_fullsized":"2023-09-28T00:15:29.401695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400097+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:15:29.400097+0000","last_peered":"2023-09-28T00:15:29.400097+0000","last_clean":"2023-09-28T00:15:29.400097+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:15:29.400097+0000","last_undegraded":"2023-09-28T00:15:29.400097+0000","last_fullsized":"2023-09-28T00:15:29.400097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386237+0000","last_change":"2023-09-28T00:15:29.386237+0000","last_active":"2023-09-28T00:15:29.386237+0000","last_peered":"2023-09-28T00:15:29.386237+0000","last_clean":"2023-09-28T00:15:29.386237+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:15:29.386237+0000","last_undegraded":"2023-09-28T00:15:29.386237+0000","last_fullsized":"2023-09-28T00:15:29.386237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403381+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:15:29.403381+0000","last_peered":"2023-09-28T00:15:29.403381+0000","last_clean":"2023-09-28T00:15:29.403381+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:15:29.403381+0000","last_undegraded":"2023-09-28T00:15:29.403381+0000","last_fullsized":"2023-09-28T00:15:29.403381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:49:33.646923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392231+0000","last_change":"2023-09-28T00:15:29.392231+0000","last_active":"2023-09-28T00:15:29.392231+0000","last_peered":"2023-09-28T00:15:29.392231+0000","last_clean":"2023-09-28T00:15:29.392231+0000","last_became_active":"2023-09-28T00:15:29.391855+0000","last_became_peered":"2023-09-28T00:15:29.391855+0000","last_unstale":"2023-09-28T00:15:29.392231+0000","last_undegraded":"2023-09-28T00:15:29.392231+0000","last_fullsized":"2023-09-28T00:15:29.392231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394242+0000","last_change":"2023-09-28T00:15:29.394242+0000","last_active":"2023-09-28T00:15:29.394242+0000","last_peered":"2023-09-28T00:15:29.394242+0000","last_clean":"2023-09-28T00:15:29.394242+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:15:29.394242+0000","last_undegraded":"2023-09-28T00:15:29.394242+0000","last_fullsized":"2023-09-28T00:15:29.394242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.389082+0000","last_change":"2023-09-28T00:15:29.389082+0000","last_active":"2023-09-28T00:15:29.389082+0000","last_peered":"2023-09-28T00:15:29.389082+0000","last_clean":"2023-09-28T00:15:29.389082+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:15:29.389082+0000","last_undegraded":"2023-09-28T00:15:29.389082+0000","last_fullsized":"2023-09-28T00:15:29.389082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392532+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:15:29.392532+0000","last_peered":"2023-09-28T00:15:29.392532+0000","last_clean":"2023-09-28T00:15:29.392532+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:15:29.392532+0000","last_undegraded":"2023-09-28T00:15:29.392532+0000","last_fullsized":"2023-09-28T00:15:29.392532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392586+0000","last_change":"2023-09-28T00:15:29.392586+0000","last_active":"2023-09-28T00:15:29.392586+0000","last_peered":"2023-09-28T00:15:29.392586+0000","last_clean":"2023-09-28T00:15:29.392586+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:15:29.392586+0000","last_undegraded":"2023-09-28T00:15:29.392586+0000","last_fullsized":"2023-09-28T00:15:29.392586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:16:11.243076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.384837+0000","last_change":"2023-09-28T00:15:29.384837+0000","last_active":"2023-09-28T00:15:29.384837+0000","last_peered":"2023-09-28T00:15:29.384837+0000","last_clean":"2023-09-28T00:15:29.384837+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:15:29.384837+0000","last_undegraded":"2023-09-28T00:15:29.384837+0000","last_fullsized":"2023-09-28T00:15:29.384837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:49:32.973094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398577+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:15:29.398577+0000","last_peered":"2023-09-28T00:15:29.398577+0000","last_clean":"2023-09-28T00:15:29.398577+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:15:29.398577+0000","last_undegraded":"2023-09-28T00:15:29.398577+0000","last_fullsized":"2023-09-28T00:15:29.398577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399602+0000","last_change":"2023-09-28T00:15:28.982899+0000","last_active":"2023-09-28T00:15:29.399602+0000","last_peered":"2023-09-28T00:15:29.399602+0000","last_clean":"2023-09-28T00:15:29.399602+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:15:29.399602+0000","last_undegraded":"2023-09-28T00:15:29.399602+0000","last_fullsized":"2023-09-28T00:15:29.399602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.383398+0000","last_change":"2023-09-28T00:15:29.383398+0000","last_active":"2023-09-28T00:15:29.383398+0000","last_peered":"2023-09-28T00:15:29.383398+0000","last_clean":"2023-09-28T00:15:29.383398+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:15:29.383398+0000","last_undegraded":"2023-09-28T00:15:29.383398+0000","last_fullsized":"2023-09-28T00:15:29.383398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.986263+0000","last_change":"2023-09-28T00:15:28.984308+0000","last_active":"2023-09-28T00:15:28.986263+0000","last_peered":"2023-09-28T00:15:28.986263+0000","last_clean":"2023-09-28T00:15:28.986263+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:15:28.986263+0000","last_undegraded":"2023-09-28T00:15:28.986263+0000","last_fullsized":"2023-09-28T00:15:28.986263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399205+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:15:29.399205+0000","last_peered":"2023-09-28T00:15:29.399205+0000","last_clean":"2023-09-28T00:15:29.399205+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:15:29.399205+0000","last_undegraded":"2023-09-28T00:15:29.399205+0000","last_fullsized":"2023-09-28T00:15:29.399205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.987965+0000","last_change":"2023-09-28T00:15:28.986600+0000","last_active":"2023-09-28T00:15:28.987965+0000","last_peered":"2023-09-28T00:15:28.987965+0000","last_clean":"2023-09-28T00:15:28.987965+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:15:28.987965+0000","last_undegraded":"2023-09-28T00:15:28.987965+0000","last_fullsized":"2023-09-28T00:15:28.987965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397007+0000","last_change":"2023-09-28T00:15:29.391209+0000","last_active":"2023-09-28T00:15:29.397007+0000","last_peered":"2023-09-28T00:15:29.397007+0000","last_clean":"2023-09-28T00:15:29.397007+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:15:29.397007+0000","last_undegraded":"2023-09-28T00:15:29.397007+0000","last_fullsized":"2023-09-28T00:15:29.397007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.991009+0000","last_change":"2023-09-28T00:15:28.990492+0000","last_active":"2023-09-28T00:15:28.991009+0000","last_peered":"2023-09-28T00:15:28.991009+0000","last_clean":"2023-09-28T00:15:28.991009+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:15:28.991009+0000","last_undegraded":"2023-09-28T00:15:28.991009+0000","last_fullsized":"2023-09-28T00:15:28.991009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.381022+0000","last_change":"2023-09-28T00:15:29.381022+0000","last_active":"2023-09-28T00:15:29.381022+0000","last_peered":"2023-09-28T00:15:29.381022+0000","last_clean":"2023-09-28T00:15:29.381022+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:15:29.381022+0000","last_undegraded":"2023-09-28T00:15:29.381022+0000","last_fullsized":"2023-09-28T00:15:29.381022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378888+0000","last_change":"2023-09-28T00:15:28.989043+0000","last_active":"2023-09-28T00:15:29.378888+0000","last_peered":"2023-09-28T00:15:29.378888+0000","last_clean":"2023-09-28T00:15:29.378888+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:15:29.378888+0000","last_undegraded":"2023-09-28T00:15:29.378888+0000","last_fullsized":"2023-09-28T00:15:29.378888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388831+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:15:29.388831+0000","last_peered":"2023-09-28T00:15:29.388831+0000","last_clean":"2023-09-28T00:15:29.388831+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:15:29.388831+0000","last_undegraded":"2023-09-28T00:15:29.388831+0000","last_fullsized":"2023-09-28T00:15:29.388831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396368+0000","last_change":"2023-09-28T00:15:28.981865+0000","last_active":"2023-09-28T00:15:29.396368+0000","last_peered":"2023-09-28T00:15:29.396368+0000","last_clean":"2023-09-28T00:15:29.396368+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:15:29.396368+0000","last_undegraded":"2023-09-28T00:15:29.396368+0000","last_fullsized":"2023-09-28T00:15:29.396368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.389604+0000","last_change":"2023-09-28T00:15:29.389604+0000","last_active":"2023-09-28T00:15:29.389604+0000","last_peered":"2023-09-28T00:15:29.389604+0000","last_clean":"2023-09-28T00:15:29.389604+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:15:29.389604+0000","last_undegraded":"2023-09-28T00:15:29.389604+0000","last_fullsized":"2023-09-28T00:15:29.389604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.405038+0000","last_change":"2023-09-28T00:15:28.979093+0000","last_active":"2023-09-28T00:15:29.405038+0000","last_peered":"2023-09-28T00:15:29.405038+0000","last_clean":"2023-09-28T00:15:29.405038+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:15:29.405038+0000","last_undegraded":"2023-09-28T00:15:29.405038+0000","last_fullsized":"2023-09-28T00:15:29.405038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404103+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:15:29.404103+0000","last_peered":"2023-09-28T00:15:29.404103+0000","last_clean":"2023-09-28T00:15:29.404103+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:15:29.404103+0000","last_undegraded":"2023-09-28T00:15:29.404103+0000","last_fullsized":"2023-09-28T00:15:29.404103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:59:40.497846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402701+0000","last_change":"2023-09-28T00:15:28.985348+0000","last_active":"2023-09-28T00:15:29.402701+0000","last_peered":"2023-09-28T00:15:29.402701+0000","last_clean":"2023-09-28T00:15:29.402701+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:15:29.402701+0000","last_undegraded":"2023-09-28T00:15:29.402701+0000","last_fullsized":"2023-09-28T00:15:29.402701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.383322+0000","last_change":"2023-09-28T00:15:29.383322+0000","last_active":"2023-09-28T00:15:29.383322+0000","last_peered":"2023-09-28T00:15:29.383322+0000","last_clean":"2023-09-28T00:15:29.383322+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:15:29.383322+0000","last_undegraded":"2023-09-28T00:15:29.383322+0000","last_fullsized":"2023-09-28T00:15:29.383322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.988695+0000","last_change":"2023-09-28T00:15:28.987818+0000","last_active":"2023-09-28T00:15:28.988695+0000","last_peered":"2023-09-28T00:15:28.988695+0000","last_clean":"2023-09-28T00:15:28.988695+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:15:28.988695+0000","last_undegraded":"2023-09-28T00:15:28.988695+0000","last_fullsized":"2023-09-28T00:15:28.988695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397462+0000","last_change":"2023-09-28T00:15:29.395546+0000","last_active":"2023-09-28T00:15:29.397462+0000","last_peered":"2023-09-28T00:15:29.397462+0000","last_clean":"2023-09-28T00:15:29.397462+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:15:29.397462+0000","last_undegraded":"2023-09-28T00:15:29.397462+0000","last_fullsized":"2023-09-28T00:15:29.397462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.988325+0000","last_change":"2023-09-28T00:15:28.985438+0000","last_active":"2023-09-28T00:15:28.988325+0000","last_peered":"2023-09-28T00:15:28.988325+0000","last_clean":"2023-09-28T00:15:28.988325+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:15:28.988325+0000","last_undegraded":"2023-09-28T00:15:28.988325+0000","last_fullsized":"2023-09-28T00:15:28.988325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399423+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:15:29.399423+0000","last_peered":"2023-09-28T00:15:29.399423+0000","last_clean":"2023-09-28T00:15:29.399423+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:15:29.399423+0000","last_undegraded":"2023-09-28T00:15:29.399423+0000","last_fullsized":"2023-09-28T00:15:29.399423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403755+0000","last_change":"2023-09-28T00:15:28.983275+0000","last_active":"2023-09-28T00:15:29.403755+0000","last_peered":"2023-09-28T00:15:29.403755+0000","last_clean":"2023-09-28T00:15:29.403755+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:15:29.403755+0000","last_undegraded":"2023-09-28T00:15:29.403755+0000","last_fullsized":"2023-09-28T00:15:29.403755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:10:17.162300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393952+0000","last_change":"2023-09-28T00:15:29.393952+0000","last_active":"2023-09-28T00:15:29.393952+0000","last_peered":"2023-09-28T00:15:29.393952+0000","last_clean":"2023-09-28T00:15:29.393952+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:15:29.393952+0000","last_undegraded":"2023-09-28T00:15:29.393952+0000","last_fullsized":"2023-09-28T00:15:29.393952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.382975+0000","last_change":"2023-09-28T00:15:28.986391+0000","last_active":"2023-09-28T00:15:29.382975+0000","last_peered":"2023-09-28T00:15:29.382975+0000","last_clean":"2023-09-28T00:15:29.382975+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:15:29.382975+0000","last_undegraded":"2023-09-28T00:15:29.382975+0000","last_fullsized":"2023-09-28T00:15:29.382975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396755+0000","last_change":"2023-09-28T00:15:29.393474+0000","last_active":"2023-09-28T00:15:29.396755+0000","last_peered":"2023-09-28T00:15:29.396755+0000","last_clean":"2023-09-28T00:15:29.396755+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:15:29.396755+0000","last_undegraded":"2023-09-28T00:15:29.396755+0000","last_fullsized":"2023-09-28T00:15:29.396755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395391+0000","last_change":"2023-09-28T00:15:28.986082+0000","last_active":"2023-09-28T00:15:29.395391+0000","last_peered":"2023-09-28T00:15:29.395391+0000","last_clean":"2023-09-28T00:15:29.395391+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:15:29.395391+0000","last_undegraded":"2023-09-28T00:15:29.395391+0000","last_fullsized":"2023-09-28T00:15:29.395391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:16.392360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397610+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:15:29.397610+0000","last_peered":"2023-09-28T00:15:29.397610+0000","last_clean":"2023-09-28T00:15:29.397610+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:15:29.397610+0000","last_undegraded":"2023-09-28T00:15:29.397610+0000","last_fullsized":"2023-09-28T00:15:29.397610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:11:37.490848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379384+0000","last_change":"2023-09-28T00:15:28.982433+0000","last_active":"2023-09-28T00:15:29.379384+0000","last_peered":"2023-09-28T00:15:29.379384+0000","last_clean":"2023-09-28T00:15:29.379384+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:15:29.379384+0000","last_undegraded":"2023-09-28T00:15:29.379384+0000","last_fullsized":"2023-09-28T00:15:29.379384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:37:52.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395572+0000","last_change":"2023-09-28T00:15:29.388766+0000","last_active":"2023-09-28T00:15:29.395572+0000","last_peered":"2023-09-28T00:15:29.395572+0000","last_clean":"2023-09-28T00:15:29.395572+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:15:29.395572+0000","last_undegraded":"2023-09-28T00:15:29.395572+0000","last_fullsized":"2023-09-28T00:15:29.395572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.381202+0000","last_change":"2023-09-28T00:15:28.984089+0000","last_active":"2023-09-28T00:15:29.381202+0000","last_peered":"2023-09-28T00:15:29.381202+0000","last_clean":"2023-09-28T00:15:29.381202+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:15:29.381202+0000","last_undegraded":"2023-09-28T00:15:29.381202+0000","last_fullsized":"2023-09-28T00:15:29.381202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386850+0000","last_change":"2023-09-28T00:15:29.386850+0000","last_active":"2023-09-28T00:15:29.386850+0000","last_peered":"2023-09-28T00:15:29.386850+0000","last_clean":"2023-09-28T00:15:29.386850+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:15:29.386850+0000","last_undegraded":"2023-09-28T00:15:29.386850+0000","last_fullsized":"2023-09-28T00:15:29.386850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402181+0000","last_change":"2023-09-28T00:15:28.986069+0000","last_active":"2023-09-28T00:15:29.402181+0000","last_peered":"2023-09-28T00:15:29.402181+0000","last_clean":"2023-09-28T00:15:29.402181+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:15:29.402181+0000","last_undegraded":"2023-09-28T00:15:29.402181+0000","last_fullsized":"2023-09-28T00:15:29.402181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397756+0000","last_change":"2023-09-28T00:15:29.393182+0000","last_active":"2023-09-28T00:15:29.397756+0000","last_peered":"2023-09-28T00:15:29.397756+0000","last_clean":"2023-09-28T00:15:29.397756+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:15:29.397756+0000","last_undegraded":"2023-09-28T00:15:29.397756+0000","last_fullsized":"2023-09-28T00:15:29.397756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385144+0000","last_change":"2023-09-28T00:15:28.985291+0000","last_active":"2023-09-28T00:15:29.385144+0000","last_peered":"2023-09-28T00:15:29.385144+0000","last_clean":"2023-09-28T00:15:29.385144+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:15:29.385144+0000","last_undegraded":"2023-09-28T00:15:29.385144+0000","last_fullsized":"2023-09-28T00:15:29.385144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404083+0000","last_change":"2023-09-28T00:15:29.400083+0000","last_active":"2023-09-28T00:15:29.404083+0000","last_peered":"2023-09-28T00:15:29.404083+0000","last_clean":"2023-09-28T00:15:29.404083+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:15:29.404083+0000","last_undegraded":"2023-09-28T00:15:29.404083+0000","last_fullsized":"2023-09-28T00:15:29.404083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385946+0000","last_change":"2023-09-28T00:15:28.980715+0000","last_active":"2023-09-28T00:15:29.385946+0000","last_peered":"2023-09-28T00:15:29.385946+0000","last_clean":"2023-09-28T00:15:29.385946+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:15:29.385946+0000","last_undegraded":"2023-09-28T00:15:29.385946+0000","last_fullsized":"2023-09-28T00:15:29.385946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400065+0000","last_change":"2023-09-28T00:15:29.397875+0000","last_active":"2023-09-28T00:15:29.400065+0000","last_peered":"2023-09-28T00:15:29.400065+0000","last_clean":"2023-09-28T00:15:29.400065+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:15:29.400065+0000","last_undegraded":"2023-09-28T00:15:29.400065+0000","last_fullsized":"2023-09-28T00:15:29.400065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:35:06.112174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.987946+0000","last_change":"2023-09-28T00:15:28.986410+0000","last_active":"2023-09-28T00:15:28.987946+0000","last_peered":"2023-09-28T00:15:28.987946+0000","last_clean":"2023-09-28T00:15:28.987946+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:15:28.987946+0000","last_undegraded":"2023-09-28T00:15:28.987946+0000","last_fullsized":"2023-09-28T00:15:28.987946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392748+0000","last_change":"2023-09-28T00:15:29.392748+0000","last_active":"2023-09-28T00:15:29.392748+0000","last_peered":"2023-09-28T00:15:29.392748+0000","last_clean":"2023-09-28T00:15:29.392748+0000","last_became_active":"2023-09-28T00:15:29.392336+0000","last_became_peered":"2023-09-28T00:15:29.392336+0000","last_unstale":"2023-09-28T00:15:29.392748+0000","last_undegraded":"2023-09-28T00:15:29.392748+0000","last_fullsized":"2023-09-28T00:15:29.392748+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.974649+0000","last_change":"2023-09-28T00:15:24.193273+0000","last_active":"2023-09-28T00:15:28.974649+0000","last_peered":"2023-09-28T00:15:28.974649+0000","last_clean":"2023-09-28T00:15:28.974649+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:15:28.974649+0000","last_undegraded":"2023-09-28T00:15:28.974649+0000","last_fullsized":"2023-09-28T00:15:28.974649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:55:44.401134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379326+0000","last_change":"2023-09-28T00:15:28.986194+0000","last_active":"2023-09-28T00:15:29.379326+0000","last_peered":"2023-09-28T00:15:29.379326+0000","last_clean":"2023-09-28T00:15:29.379326+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:15:29.379326+0000","last_undegraded":"2023-09-28T00:15:29.379326+0000","last_fullsized":"2023-09-28T00:15:29.379326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388604+0000","last_change":"2023-09-28T00:15:29.388604+0000","last_active":"2023-09-28T00:15:29.388604+0000","last_peered":"2023-09-28T00:15:29.388604+0000","last_clean":"2023-09-28T00:15:29.388604+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:15:29.388604+0000","last_undegraded":"2023-09-28T00:15:29.388604+0000","last_fullsized":"2023-09-28T00:15:29.388604+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378226+0000","last_change":"2023-09-28T00:15:23.950475+0000","last_active":"2023-09-28T00:15:29.378226+0000","last_peered":"2023-09-28T00:15:29.378226+0000","last_clean":"2023-09-28T00:15:29.378226+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:15:29.378226+0000","last_undegraded":"2023-09-28T00:15:29.378226+0000","last_fullsized":"2023-09-28T00:15:29.378226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386282+0000","last_change":"2023-09-28T00:15:28.984604+0000","last_active":"2023-09-28T00:15:29.386282+0000","last_peered":"2023-09-28T00:15:29.386282+0000","last_clean":"2023-09-28T00:15:29.386282+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:15:29.386282+0000","last_undegraded":"2023-09-28T00:15:29.386282+0000","last_fullsized":"2023-09-28T00:15:29.386282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.392616+0000","last_change":"2023-09-28T00:15:29.392616+0000","last_active":"2023-09-28T00:15:29.392616+0000","last_peered":"2023-09-28T00:15:29.392616+0000","last_clean":"2023-09-28T00:15:29.392616+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:15:29.392616+0000","last_undegraded":"2023-09-28T00:15:29.392616+0000","last_fullsized":"2023-09-28T00:15:29.392616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:20:56.060002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.969042+0000","last_change":"2023-09-28T00:15:24.193731+0000","last_active":"2023-09-28T00:15:28.969042+0000","last_peered":"2023-09-28T00:15:28.969042+0000","last_clean":"2023-09-28T00:15:28.969042+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:15:28.969042+0000","last_undegraded":"2023-09-28T00:15:28.969042+0000","last_fullsized":"2023-09-28T00:15:28.969042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:10:07.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.984853+0000","last_change":"2023-09-28T00:15:28.980294+0000","last_active":"2023-09-28T00:15:28.984853+0000","last_peered":"2023-09-28T00:15:28.984853+0000","last_clean":"2023-09-28T00:15:28.984853+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:15:28.984853+0000","last_undegraded":"2023-09-28T00:15:28.984853+0000","last_fullsized":"2023-09-28T00:15:28.984853+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388008+0000","last_change":"2023-09-28T00:15:29.388008+0000","last_active":"2023-09-28T00:15:29.388008+0000","last_peered":"2023-09-28T00:15:29.388008+0000","last_clean":"2023-09-28T00:15:29.388008+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:15:29.388008+0000","last_undegraded":"2023-09-28T00:15:29.388008+0000","last_fullsized":"2023-09-28T00:15:29.388008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.377855+0000","last_change":"2023-09-28T00:15:23.950457+0000","last_active":"2023-09-28T00:15:29.377855+0000","last_peered":"2023-09-28T00:15:29.377855+0000","last_clean":"2023-09-28T00:15:29.377855+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:15:29.377855+0000","last_undegraded":"2023-09-28T00:15:29.377855+0000","last_fullsized":"2023-09-28T00:15:29.377855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.970751+0000","last_change":"2023-09-28T00:15:16.995081+0000","last_active":"2023-09-28T00:15:28.970751+0000","last_peered":"2023-09-28T00:15:28.970751+0000","last_clean":"2023-09-28T00:15:28.970751+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:15:28.970751+0000","last_undegraded":"2023-09-28T00:15:28.970751+0000","last_fullsized":"2023-09-28T00:15:28.970751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_clean_scrub_stamp":"2023-09-28T00:15:15.867916+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:37:49.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.986865+0000","last_change":"2023-09-28T00:15:28.985016+0000","last_active":"2023-09-28T00:15:28.986865+0000","last_peered":"2023-09-28T00:15:28.986865+0000","last_clean":"2023-09-28T00:15:28.986865+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:15:28.986865+0000","last_undegraded":"2023-09-28T00:15:28.986865+0000","last_fullsized":"2023-09-28T00:15:28.986865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403095+0000","last_change":"2023-09-28T00:15:29.401863+0000","last_active":"2023-09-28T00:15:29.403095+0000","last_peered":"2023-09-28T00:15:29.403095+0000","last_clean":"2023-09-28T00:15:29.403095+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:15:29.403095+0000","last_undegraded":"2023-09-28T00:15:29.403095+0000","last_fullsized":"2023-09-28T00:15:29.403095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:17.400054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.970857+0000","last_change":"2023-09-28T00:15:23.946737+0000","last_active":"2023-09-28T00:15:28.970857+0000","last_peered":"2023-09-28T00:15:28.970857+0000","last_clean":"2023-09-28T00:15:28.970857+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:15:28.970857+0000","last_undegraded":"2023-09-28T00:15:28.970857+0000","last_fullsized":"2023-09-28T00:15:28.970857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.988359+0000","last_change":"2023-09-28T00:15:28.986464+0000","last_active":"2023-09-28T00:15:28.988359+0000","last_peered":"2023-09-28T00:15:28.988359+0000","last_clean":"2023-09-28T00:15:28.988359+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:15:28.988359+0000","last_undegraded":"2023-09-28T00:15:28.988359+0000","last_fullsized":"2023-09-28T00:15:28.988359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390313+0000","last_change":"2023-09-28T00:15:29.390313+0000","last_active":"2023-09-28T00:15:29.390313+0000","last_peered":"2023-09-28T00:15:29.390313+0000","last_clean":"2023-09-28T00:15:29.390313+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:15:29.390313+0000","last_undegraded":"2023-09-28T00:15:29.390313+0000","last_fullsized":"2023-09-28T00:15:29.390313+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.971043+0000","last_change":"2023-09-28T00:15:24.193260+0000","last_active":"2023-09-28T00:15:28.971043+0000","last_peered":"2023-09-28T00:15:28.971043+0000","last_clean":"2023-09-28T00:15:28.971043+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:15:28.971043+0000","last_undegraded":"2023-09-28T00:15:28.971043+0000","last_fullsized":"2023-09-28T00:15:28.971043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.984985+0000","last_change":"2023-09-28T00:15:28.979725+0000","last_active":"2023-09-28T00:15:28.984985+0000","last_peered":"2023-09-28T00:15:28.984985+0000","last_clean":"2023-09-28T00:15:28.984985+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:15:28.984985+0000","last_undegraded":"2023-09-28T00:15:28.984985+0000","last_fullsized":"2023-09-28T00:15:28.984985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398984+0000","last_change":"2023-09-28T00:15:29.398984+0000","last_active":"2023-09-28T00:15:29.398984+0000","last_peered":"2023-09-28T00:15:29.398984+0000","last_clean":"2023-09-28T00:15:29.398984+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:15:29.398984+0000","last_undegraded":"2023-09-28T00:15:29.398984+0000","last_fullsized":"2023-09-28T00:15:29.398984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394909+0000","last_change":"2023-09-28T00:15:28.989236+0000","last_active":"2023-09-28T00:15:29.394909+0000","last_peered":"2023-09-28T00:15:29.394909+0000","last_clean":"2023-09-28T00:15:29.394909+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:15:29.394909+0000","last_undegraded":"2023-09-28T00:15:29.394909+0000","last_fullsized":"2023-09-28T00:15:29.394909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.974926+0000","last_change":"2023-09-28T00:15:23.949425+0000","last_active":"2023-09-28T00:15:28.974926+0000","last_peered":"2023-09-28T00:15:28.974926+0000","last_clean":"2023-09-28T00:15:28.974926+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:15:28.974926+0000","last_undegraded":"2023-09-28T00:15:28.974926+0000","last_fullsized":"2023-09-28T00:15:28.974926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:59:04.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386508+0000","last_change":"2023-09-28T00:15:29.386508+0000","last_active":"2023-09-28T00:15:29.386508+0000","last_peered":"2023-09-28T00:15:29.386508+0000","last_clean":"2023-09-28T00:15:29.386508+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:15:29.386508+0000","last_undegraded":"2023-09-28T00:15:29.386508+0000","last_fullsized":"2023-09-28T00:15:29.386508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385234+0000","last_change":"2023-09-28T00:15:23.949692+0000","last_active":"2023-09-28T00:15:29.385234+0000","last_peered":"2023-09-28T00:15:29.385234+0000","last_clean":"2023-09-28T00:15:29.385234+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:15:29.385234+0000","last_undegraded":"2023-09-28T00:15:29.385234+0000","last_fullsized":"2023-09-28T00:15:29.385234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:48:11.275095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-09-28T00:15:28.989159+0000","last_change":"2023-09-28T00:15:28.988077+0000","last_active":"2023-09-28T00:15:28.989159+0000","last_peered":"2023-09-28T00:15:28.989159+0000","last_clean":"2023-09-28T00:15:28.989159+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:15:28.989159+0000","last_undegraded":"2023-09-28T00:15:28.989159+0000","last_fullsized":"2023-09-28T00:15:28.989159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399373+0000","last_change":"2023-09-28T00:15:29.398170+0000","last_active":"2023-09-28T00:15:29.399373+0000","last_peered":"2023-09-28T00:15:29.399373+0000","last_clean":"2023-09-28T00:15:29.399373+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:15:29.399373+0000","last_undegraded":"2023-09-28T00:15:29.399373+0000","last_fullsized":"2023-09-28T00:15:29.399373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:30:23.382889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.389888+0000","last_change":"2023-09-28T00:15:28.987224+0000","last_active":"2023-09-28T00:15:29.389888+0000","last_peered":"2023-09-28T00:15:29.389888+0000","last_clean":"2023-09-28T00:15:29.389888+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:15:29.389888+0000","last_undegraded":"2023-09-28T00:15:29.389888+0000","last_fullsized":"2023-09-28T00:15:29.389888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.383759+0000","last_change":"2023-09-28T00:15:29.383759+0000","last_active":"2023-09-28T00:15:29.383759+0000","last_peered":"2023-09-28T00:15:29.383759+0000","last_clean":"2023-09-28T00:15:29.383759+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:15:29.383759+0000","last_undegraded":"2023-09-28T00:15:29.383759+0000","last_fullsized":"2023-09-28T00:15:29.383759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:06.286162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402275+0000","last_change":"2023-09-28T00:15:28.987633+0000","last_active":"2023-09-28T00:15:29.402275+0000","last_peered":"2023-09-28T00:15:29.402275+0000","last_clean":"2023-09-28T00:15:29.402275+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:15:29.402275+0000","last_undegraded":"2023-09-28T00:15:29.402275+0000","last_fullsized":"2023-09-28T00:15:29.402275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398131+0000","last_change":"2023-09-28T00:15:29.392897+0000","last_active":"2023-09-28T00:15:29.398131+0000","last_peered":"2023-09-28T00:15:29.398131+0000","last_clean":"2023-09-28T00:15:29.398131+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:15:29.398131+0000","last_undegraded":"2023-09-28T00:15:29.398131+0000","last_fullsized":"2023-09-28T00:15:29.398131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403684+0000","last_change":"2023-09-28T00:15:28.987962+0000","last_active":"2023-09-28T00:15:29.403684+0000","last_peered":"2023-09-28T00:15:29.403684+0000","last_clean":"2023-09-28T00:15:29.403684+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:15:29.403684+0000","last_undegraded":"2023-09-28T00:15:29.403684+0000","last_fullsized":"2023-09-28T00:15:29.403684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399076+0000","last_change":"2023-09-28T00:15:29.394598+0000","last_active":"2023-09-28T00:15:29.399076+0000","last_peered":"2023-09-28T00:15:29.399076+0000","last_clean":"2023-09-28T00:15:29.399076+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:15:29.399076+0000","last_undegraded":"2023-09-28T00:15:29.399076+0000","last_fullsized":"2023-09-28T00:15:29.399076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375726+0000","last_change":"2023-09-28T00:15:28.983686+0000","last_active":"2023-09-28T00:15:29.375726+0000","last_peered":"2023-09-28T00:15:29.375726+0000","last_clean":"2023-09-28T00:15:29.375726+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:15:29.375726+0000","last_undegraded":"2023-09-28T00:15:29.375726+0000","last_fullsized":"2023-09-28T00:15:29.375726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.384759+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:15:29.384759+0000","last_peered":"2023-09-28T00:15:29.384759+0000","last_clean":"2023-09-28T00:15:29.384759+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:15:29.384759+0000","last_undegraded":"2023-09-28T00:15:29.384759+0000","last_fullsized":"2023-09-28T00:15:29.384759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402470+0000","last_change":"2023-09-28T00:15:28.985280+0000","last_active":"2023-09-28T00:15:29.402470+0000","last_peered":"2023-09-28T00:15:29.402470+0000","last_clean":"2023-09-28T00:15:29.402470+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:15:29.402470+0000","last_undegraded":"2023-09-28T00:15:29.402470+0000","last_fullsized":"2023-09-28T00:15:29.402470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400030+0000","last_change":"2023-09-28T00:15:29.398360+0000","last_active":"2023-09-28T00:15:29.400030+0000","last_peered":"2023-09-28T00:15:29.400030+0000","last_clean":"2023-09-28T00:15:29.400030+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:15:29.400030+0000","last_undegraded":"2023-09-28T00:15:29.400030+0000","last_fullsized":"2023-09-28T00:15:29.400030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:58:13.878285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400854+0000","last_change":"2023-09-28T00:15:29.395080+0000","last_active":"2023-09-28T00:15:29.400854+0000","last_peered":"2023-09-28T00:15:29.400854+0000","last_clean":"2023-09-28T00:15:29.400854+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:15:29.400854+0000","last_undegraded":"2023-09-28T00:15:29.400854+0000","last_fullsized":"2023-09-28T00:15:29.400854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:39.792299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.384589+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:15:29.384589+0000","last_peered":"2023-09-28T00:15:29.384589+0000","last_clean":"2023-09-28T00:15:29.384589+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:15:29.384589+0000","last_undegraded":"2023-09-28T00:15:29.384589+0000","last_fullsized":"2023-09-28T00:15:29.384589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403283+0000","last_change":"2023-09-28T00:15:29.399203+0000","last_active":"2023-09-28T00:15:29.403283+0000","last_peered":"2023-09-28T00:15:29.403283+0000","last_clean":"2023-09-28T00:15:29.403283+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:15:29.403283+0000","last_undegraded":"2023-09-28T00:15:29.403283+0000","last_fullsized":"2023-09-28T00:15:29.403283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:47:48.079491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388644+0000","last_change":"2023-09-28T00:15:29.388644+0000","last_active":"2023-09-28T00:15:29.388644+0000","last_peered":"2023-09-28T00:15:29.388644+0000","last_clean":"2023-09-28T00:15:29.388644+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:15:29.388644+0000","last_undegraded":"2023-09-28T00:15:29.388644+0000","last_fullsized":"2023-09-28T00:15:29.388644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":8,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.388432+0000","last_change":"2023-09-28T00:15:29.388432+0000","last_active":"2023-09-28T00:15:29.388432+0000","last_peered":"2023-09-28T00:15:29.388432+0000","last_clean":"2023-09-28T00:15:29.388432+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:15:29.388432+0000","last_undegraded":"2023-09-28T00:15:29.388432+0000","last_fullsized":"2023-09-28T00:15:29.388432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7992,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363848,"statfs":{"total":96636764160,"available":96628580352,"internally_reserved":0,"allocated":245760,"data_stored":87121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8048,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363792,"statfs":{"total":96636764160,"available":96628523008,"internally_reserved":0,"allocated":237568,"data_stored":86497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9080,"kb_used_data":816,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362760,"statfs":{"total":96636764160,"available":96627466240,"internally_reserved":0,"allocated":835584,"data_stored":677419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,6,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5640000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2610000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4400000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9104,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362736,"statfs":{"total":96636764160,"available":96627441664,"internally_reserved":0,"allocated":860160,"data_stored":678617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7844,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94363996,"statfs":{"total":96636764160,"available":96628731904,"internally_reserved":0,"allocated":225280,"data_stored":79381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":86587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8068,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363772,"statfs":{"total":96636764160,"available":96628502528,"internally_reserved":0,"allocated":258048,"data_stored":88089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:15:33.867 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-28T00:15:33.867 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-28T00:15:33.868 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-28T00:15:33.868 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-28T00:15:33.868 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-28T00:15:34.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.019+0000 7f949d25e700 1 Processor -- start 2023-09-28T00:15:34.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.019+0000 7f949d25e700 1 -- start start 2023-09-28T00:15:34.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.019+0000 7f949d25e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f949815d560 0x7f94980d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.019+0000 7f949d25e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 0x7f94980b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.019+0000 7f949d25e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f94981591b0 0x7f9498159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.019+0000 7f949d25e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94980b2ad0 con 0x7f949815d560 2023-09-28T00:15:34.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.019+0000 7f949d25e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94980b4160 con 0x7f94981591b0 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.019+0000 7f949d25e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94980b1f80 con 0x7f949815d930 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9496d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f949815d560 0x7f94980d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9496d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f949815d560 0x7f94980d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46386/0 (socket says 172.21.15.26:46386) 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9496d9d700 1 -- 172.21.15.26:0/3507781116 learned_addr learned my addr 172.21.15.26:0/3507781116 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f949759e700 1 --2- 172.21.15.26:0/3507781116 >> v2:172.21.15.190:3300/0 conn(0x7f94981591b0 0x7f9498159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9496d9d700 1 -- 172.21.15.26:0/3507781116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 msgr2=0x7f94980b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f949659c700 1 --2- 172.21.15.26:0/3507781116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 0x7f94980b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9496d9d700 1 --2- 172.21.15.26:0/3507781116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 0x7f94980b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9496d9d700 1 -- 172.21.15.26:0/3507781116 >> v2:172.21.15.190:3300/0 conn(0x7f94981591b0 msgr2=0x7f9498159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9496d9d700 1 --2- 172.21.15.26:0/3507781116 >> v2:172.21.15.190:3300/0 conn(0x7f94981591b0 0x7f9498159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9496d9d700 1 -- 172.21.15.26:0/3507781116 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498159b70 con 0x7f949815d560 2023-09-28T00:15:34.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f949759e700 1 --2- 172.21.15.26:0/3507781116 >> v2:172.21.15.190:3300/0 conn(0x7f94981591b0 0x7f9498159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9496d9d700 1 --2- 172.21.15.26:0/3507781116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 0x7f94980d0030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f94880099b0 tx=0x7f9488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9f20d1dfcbb222 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9495d9b700 1 -- 172.21.15.26:0/3507781116 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800b820 con 0x7f949815d560 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9495d9b700 1 -- 172.21.15.26:0/3507781116 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948800b980 con 0x7f949815d560 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.020+0000 7f9495d9b700 1 -- 172.21.15.26:0/3507781116 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948800bd20 con 0x7f949815d560 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.021+0000 7f949d25e700 1 -- 172.21.15.26:0/3507781116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 msgr2=0x7f94980d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.021+0000 7f949d25e700 1 --2- 172.21.15.26:0/3507781116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 0x7f94980d0030 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f94880099b0 tx=0x7f9488009250 comp rx=0 tx=0).stop 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.021+0000 7f949d25e700 1 -- 172.21.15.26:0/3507781116 shutdown_connections 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.021+0000 7f949d25e700 1 --2- 172.21.15.26:0/3507781116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 0x7f94980d0030 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.021+0000 7f949d25e700 1 --2- 172.21.15.26:0/3507781116 >> v2:172.21.15.190:3300/0 conn(0x7f94981591b0 0x7f9498159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.021+0000 7f949d25e700 1 --2- 172.21.15.26:0/3507781116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 0x7f94980b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.021+0000 7f949d25e700 1 -- 172.21.15.26:0/3507781116 >> 172.21.15.26:0/3507781116 conn(0x7f94980d1180 msgr2=0x7f9498069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:34.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.021+0000 7f949d25e700 1 -- 172.21.15.26:0/3507781116 shutdown_connections 2023-09-28T00:15:34.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.021+0000 7f949d25e700 1 -- 172.21.15.26:0/3507781116 wait complete. 2023-09-28T00:15:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.022+0000 7f949d25e700 1 Processor -- start 2023-09-28T00:15:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.022+0000 7f949d25e700 1 -- start start 2023-09-28T00:15:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949d25e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94981591b0 0x7f949814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949d25e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 0x7f94980b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949d25e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 0x7f949815be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949d25e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949815ccc0 con 0x7f949815d560 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949d25e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949814e870 con 0x7f94981591b0 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949d25e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9498153ba0 con 0x7f949815d930 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 0x7f94980b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 0x7f94980b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46402/0 (socket says 172.21.15.26:46402) 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949659c700 1 -- 172.21.15.26:0/3774108648 learned_addr learned my addr 172.21.15.26:0/3774108648 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f9496d9d700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94981591b0 0x7f949814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949759e700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 0x7f949815be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949659c700 1 -- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 msgr2=0x7f949815be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949659c700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 0x7f949815be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949659c700 1 -- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94981591b0 msgr2=0x7f949814e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949659c700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94981591b0 0x7f949814e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949659c700 1 -- 172.21.15.26:0/3774108648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94880094f0 con 0x7f949815d560 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949759e700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 0x7f949815be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949659c700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 0x7f94980b5810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f948000c8b0 tx=0x7f9480008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f948effd700 1 -- 172.21.15.26:0/3774108648 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480011600 con 0x7f949815d560 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f948effd700 1 -- 172.21.15.26:0/3774108648 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480011760 con 0x7f949815d560 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949814d850 con 0x7f949815d560 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f948effd700 1 -- 172.21.15.26:0/3774108648 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480011b00 con 0x7f949815d560 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.023+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949814de10 con 0x7f949815d560 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.024+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9498064050 con 0x7f949815d560 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.025+0000 7f948effd700 1 -- 172.21.15.26:0/3774108648 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f94800223a0 con 0x7f949815d560 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.025+0000 7f948effd700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9478067330 0x7f94780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.025+0000 7f948effd700 1 -- 172.21.15.26:0/3774108648 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9480084c10 con 0x7f949815d560 2023-09-28T00:15:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.025+0000 7f9496d9d700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9478067330 0x7f94780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.026+0000 7f9496d9d700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9478067330 0x7f94780697e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f94880099b0 tx=0x7f9488017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.029+0000 7f948effd700 1 -- 172.21.15.26:0/3774108648 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9480051b10 con 0x7f949815d560 2023-09-28T00:15:34.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.280+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f94980b2230 con 0x7f949815d560 2023-09-28T00:15:34.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.283+0000 7f948effd700 1 -- 172.21.15.26:0/3774108648 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164225 (secure 0 0 0) 0x7f9480015090 con 0x7f949815d560 2023-09-28T00:15:34.286 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:34.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9478067330 msgr2=0x7f94780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9478067330 0x7f94780697e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f94880099b0 tx=0x7f9488017000 comp rx=0 tx=0).stop 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 msgr2=0x7f94980b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 0x7f94980b5810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f948000c8b0 tx=0x7f9480008040 comp rx=0 tx=0).stop 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 shutdown_connections 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9478067330 0x7f94780697e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f949815d930 0x7f949815be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f94981591b0 0x7f949814e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 --2- 172.21.15.26:0/3774108648 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f949815d560 0x7f94980b5810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 >> 172.21.15.26:0/3774108648 conn(0x7f94980d1180 msgr2=0x7f949814cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 shutdown_connections 2023-09-28T00:15:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.286+0000 7f949d25e700 1 -- 172.21.15.26:0/3774108648 wait complete. 2023-09-28T00:15:34.299 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":89869},{"type":"v1","addr":"172.21.15.190:6833","nonce":89869}]},"active_addr":"172.21.15.190:6833/89869","active_change":"2023-09-28T00:15:09.658860+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":2133712525}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":193724710}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":1671707225}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":4108479524}]}]} 2023-09-28T00:15:34.303 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-28T00:15:34.303 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-28T00:15:34.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:34.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.421+0000 7fad58bea700 1 Processor -- start 2023-09-28T00:15:34.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.421+0000 7fad58bea700 1 -- start start 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.422+0000 7fad58bea700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5415d480 0x7fad54069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.422+0000 7fad58bea700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad540687c0 con 0x7fad540b0a20 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.422+0000 7fad58bea700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad54068aa0 con 0x7fad54069da0 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.422+0000 7fad58bea700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad54068d80 con 0x7fad5415d480 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.422+0000 7fad53fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fad540b0a20 0x7fad540b5c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43888/0 (socket says 172.21.15.26:43888) 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.422+0000 7fad53fff700 1 -- 172.21.15.26:0/1144316065 learned_addr learned my addr 172.21.15.26:0/1144316065 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.422+0000 7fad537fe700 1 --2- 172.21.15.26:0/1144316065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5415d480 0x7fad54069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.422+0000 7fad527fc700 1 -- 172.21.15.26:0/1144316065 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228957923 0 0) 0x7fad540687c0 con 0x7fad540b0a20 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.422+0000 7fad527fc700 1 -- 172.21.15.26:0/1144316065 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad3c003570 con 0x7fad540b0a20 2023-09-28T00:15:34.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad527fc700 1 -- 172.21.15.26:0/1144316065 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125334383 0 0) 0x7fad54068aa0 con 0x7fad54069da0 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad527fc700 1 -- 172.21.15.26:0/1144316065 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad540687c0 con 0x7fad54069da0 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad527fc700 1 -- 172.21.15.26:0/1144316065 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 223189720 0 0) 0x7fad3c003570 con 0x7fad540b0a20 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad537fe700 1 -- 172.21.15.26:0/1144316065 >> v1:172.21.15.190:6789/0 conn(0x7fad54069da0 legacy=0x7fad540b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad537fe700 1 -- 172.21.15.26:0/1144316065 >> v1:172.21.15.26:6789/0 conn(0x7fad540b0a20 legacy=0x7fad540b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad537fe700 1 -- 172.21.15.26:0/1144316065 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54069060 con 0x7fad5415d480 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad537fe700 1 --2- 172.21.15.26:0/1144316065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5415d480 0x7fad54069860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad44009910 tx=0x7fad440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e64ae11ae2fa329 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad527fc700 1 -- 172.21.15.26:0/1144316065 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0017f0 con 0x7fad5415d480 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad527fc700 1 -- 172.21.15.26:0/1144316065 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad44011420 con 0x7fad5415d480 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.423+0000 7fad527fc700 1 -- 172.21.15.26:0/1144316065 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad440117a0 con 0x7fad5415d480 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.424+0000 7fad58bea700 1 -- 172.21.15.26:0/1144316065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5415d480 msgr2=0x7fad54069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.424+0000 7fad58bea700 1 --2- 172.21.15.26:0/1144316065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5415d480 0x7fad54069860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad44009910 tx=0x7fad440091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.424+0000 7fad58bea700 1 -- 172.21.15.26:0/1144316065 shutdown_connections 2023-09-28T00:15:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.424+0000 7fad58bea700 1 --2- 172.21.15.26:0/1144316065 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad5415d480 0x7fad54069860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.424+0000 7fad58bea700 1 -- 172.21.15.26:0/1144316065 >> 172.21.15.26:0/1144316065 conn(0x7fad540ccf80 msgr2=0x7fad540cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.424+0000 7fad58bea700 1 -- 172.21.15.26:0/1144316065 shutdown_connections 2023-09-28T00:15:34.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.424+0000 7fad58bea700 1 -- 172.21.15.26:0/1144316065 wait complete. 2023-09-28T00:15:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.425+0000 7fad58bea700 1 Processor -- start 2023-09-28T00:15:34.429 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.425+0000 7fad58bea700 1 -- start start 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad58bea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad54069da0 0x7fad540cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad58bea700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad540b0a20 0x7fad540ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad58bea700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5415d480 0x7fad54067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad58bea700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5416d950 con 0x7fad54069da0 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad58bea700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad540cb850 con 0x7fad5415d480 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad58bea700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad540aee60 con 0x7fad540b0a20 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad54069da0 0x7fad540cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad54069da0 0x7fad540cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46410/0 (socket says 172.21.15.26:46410) 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad537fe700 1 -- 172.21.15.26:0/3646513843 learned_addr learned my addr 172.21.15.26:0/3646513843 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:34.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad53fff700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5415d480 0x7fad54067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad52ffd700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad540b0a20 0x7fad540ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad537fe700 1 -- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad540b0a20 msgr2=0x7fad540ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad537fe700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad540b0a20 0x7fad540ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad537fe700 1 -- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5415d480 msgr2=0x7fad54067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad537fe700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5415d480 0x7fad54067630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad537fe700 1 -- 172.21.15.26:0/3646513843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44009420 con 0x7fad54069da0 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad53fff700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5415d480 0x7fad54067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad537fe700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad54069da0 0x7fad540cb310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fad440091e0 tx=0x7fad44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad3b7fe700 1 -- 172.21.15.26:0/3646513843 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4401cc10 con 0x7fad54069da0 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad3b7fe700 1 -- 172.21.15.26:0/3646513843 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4401cd70 con 0x7fad54069da0 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad54140800 con 0x7fad54069da0 2023-09-28T00:15:34.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.426+0000 7fad3b7fe700 1 -- 172.21.15.26:0/3646513843 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4401a6a0 con 0x7fad54069da0 2023-09-28T00:15:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.427+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad540c87f0 con 0x7fad54069da0 2023-09-28T00:15:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.427+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5404c3c0 con 0x7fad54069da0 2023-09-28T00:15:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.428+0000 7fad3b7fe700 1 -- 172.21.15.26:0/3646513843 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad4401aad0 con 0x7fad54069da0 2023-09-28T00:15:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.428+0000 7fad3b7fe700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad40067330 0x7fad400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.428+0000 7fad3b7fe700 1 -- 172.21.15.26:0/3646513843 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad44086540 con 0x7fad54069da0 2023-09-28T00:15:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.428+0000 7fad52ffd700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad40067330 0x7fad400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.429+0000 7fad52ffd700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad40067330 0x7fad400697e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad540ca0c0 tx=0x7fad48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:34.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.432+0000 7fad3b7fe700 1 -- 172.21.15.26:0/3646513843 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad44053440 con 0x7fad54069da0 2023-09-28T00:15:34.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.628+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad54069340 con 0x7fad54069da0 2023-09-28T00:15:34.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.629+0000 7fad3b7fe700 1 -- 172.21.15.26:0/3646513843 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fad44056a60 con 0x7fad54069da0 2023-09-28T00:15:34.630 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:34.630 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:30.373905+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad40067330 msgr2=0x7fad400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad40067330 0x7fad400697e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fad540ca0c0 tx=0x7fad48009040 comp rx=0 tx=0).stop 2023-09-28T00:15:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad54069da0 msgr2=0x7fad540cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad54069da0 0x7fad540cb310 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fad440091e0 tx=0x7fad44016000 comp rx=0 tx=0).stop 2023-09-28T00:15:34.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 shutdown_connections 2023-09-28T00:15:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad40067330 0x7fad400697e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad5415d480 0x7fad54067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad54069da0 0x7fad540cb310 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 --2- 172.21.15.26:0/3646513843 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad540b0a20 0x7fad540ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 >> 172.21.15.26:0/3646513843 conn(0x7fad540ccf80 msgr2=0x7fad540b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 shutdown_connections 2023-09-28T00:15:34.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.631+0000 7fad58bea700 1 -- 172.21.15.26:0/3646513843 wait complete. 2023-09-28T00:15:34.644 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-28T00:15:34.644 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.761+0000 7f70d7115700 1 Processor -- start 2023-09-28T00:15:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.761+0000 7f70d7115700 1 -- start start 2023-09-28T00:15:34.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.762+0000 7f70d7115700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f70d015d930 0x7f70d00d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.762+0000 7f70d7115700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00b2ad0 con 0x7f70d015d560 2023-09-28T00:15:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.762+0000 7f70d7115700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d00b4160 con 0x7f70d01591b0 2023-09-28T00:15:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.762+0000 7f70d7115700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00b2230 con 0x7f70d015d930 2023-09-28T00:15:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.762+0000 7f70d4eb1700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f70d015d560 0x7f70d00b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43904/0 (socket says 172.21.15.26:43904) 2023-09-28T00:15:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.762+0000 7f70d4eb1700 1 -- 172.21.15.26:0/3976740059 learned_addr learned my addr 172.21.15.26:0/3976740059 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cffff700 1 --2- 172.21.15.26:0/3976740059 >> v2:172.21.15.190:3300/0 conn(0x7f70d015d930 0x7f70d00d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cf7fe700 1 -- 172.21.15.26:0/3976740059 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464235901 0 0) 0x7f70d00b2ad0 con 0x7f70d015d560 2023-09-28T00:15:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cf7fe700 1 -- 172.21.15.26:0/3976740059 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70bc003570 con 0x7f70d015d560 2023-09-28T00:15:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cf7fe700 1 -- 172.21.15.26:0/3976740059 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117015345 0 0) 0x7f70d00b4160 con 0x7f70d01591b0 2023-09-28T00:15:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cf7fe700 1 -- 172.21.15.26:0/3976740059 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70d00b2ad0 con 0x7f70d01591b0 2023-09-28T00:15:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cffff700 1 -- 172.21.15.26:0/3976740059 >> v1:172.21.15.190:6789/0 conn(0x7f70d01591b0 legacy=0x7f70d0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cffff700 1 -- 172.21.15.26:0/3976740059 >> v1:172.21.15.26:6789/0 conn(0x7f70d015d560 legacy=0x7f70d00b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cffff700 1 -- 172.21.15.26:0/3976740059 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00b2510 con 0x7f70d015d930 2023-09-28T00:15:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cffff700 1 --2- 172.21.15.26:0/3976740059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 0x7f70d00d0030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009e60 tx=0x7f70c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf8d27d0ba309927 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cf7fe700 1 -- 172.21.15.26:0/3976740059 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c000e070 con 0x7f70d015d930 2023-09-28T00:15:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cf7fe700 1 -- 172.21.15.26:0/3976740059 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c000bab0 con 0x7f70d015d930 2023-09-28T00:15:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.763+0000 7f70cf7fe700 1 -- 172.21.15.26:0/3976740059 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c000be70 con 0x7f70d015d930 2023-09-28T00:15:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.764+0000 7f70d7115700 1 -- 172.21.15.26:0/3976740059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 msgr2=0x7f70d00d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.764+0000 7f70d7115700 1 --2- 172.21.15.26:0/3976740059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 0x7f70d00d0030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f70c0009e60 tx=0x7f70c0009780 comp rx=0 tx=0).stop 2023-09-28T00:15:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.764+0000 7f70d7115700 1 -- 172.21.15.26:0/3976740059 shutdown_connections 2023-09-28T00:15:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.764+0000 7f70d7115700 1 --2- 172.21.15.26:0/3976740059 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 0x7f70d00d0030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.764+0000 7f70d7115700 1 -- 172.21.15.26:0/3976740059 >> 172.21.15.26:0/3976740059 conn(0x7f70d00d1180 msgr2=0x7f70d0069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.764+0000 7f70d7115700 1 -- 172.21.15.26:0/3976740059 shutdown_connections 2023-09-28T00:15:34.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.764+0000 7f70d7115700 1 -- 172.21.15.26:0/3976740059 wait complete. 2023-09-28T00:15:34.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.765+0000 7f70d7115700 1 Processor -- start 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.765+0000 7f70d7115700 1 -- start start 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d7115700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70d01591b0 0x7f70d015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d7115700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70d015d560 0x7f70d00c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d7115700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 0x7f70d0147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d7115700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c6370 con 0x7f70d01591b0 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d7115700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c6560 con 0x7f70d015d930 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d7115700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00c6840 con 0x7f70d015d560 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d4eb1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70d01591b0 0x7f70d015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d4eb1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70d01591b0 0x7f70d015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46424/0 (socket says 172.21.15.26:46424) 2023-09-28T00:15:34.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d4eb1700 1 -- 172.21.15.26:0/547462095 learned_addr learned my addr 172.21.15.26:0/547462095 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70cffff700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70d015d560 0x7f70d00c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d4eb1700 1 -- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70d015d560 msgr2=0x7f70d00c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d4eb1700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70d015d560 0x7f70d00c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d4eb1700 1 -- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 msgr2=0x7f70d0147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d56b2700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 0x7f70d0147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d4eb1700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 0x7f70d0147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d4eb1700 1 -- 172.21.15.26:0/547462095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c0009a20 con 0x7f70d01591b0 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d56b2700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 0x7f70d0147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70d4eb1700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70d01591b0 0x7f70d015c550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70b800c790 tx=0x7f70b8007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:34.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.766+0000 7f70ccff9700 1 -- 172.21.15.26:0/547462095 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8005b30 con 0x7f70d01591b0 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.767+0000 7f70ccff9700 1 -- 172.21.15.26:0/547462095 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b8005c90 con 0x7f70d01591b0 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.767+0000 7f70ccff9700 1 -- 172.21.15.26:0/547462095 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b8007300 con 0x7f70d01591b0 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.767+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d00c6b20 con 0x7f70d01591b0 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.767+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d00c70e0 con 0x7f70d01591b0 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.767+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d00c7300 con 0x7f70d01591b0 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.768+0000 7f70ccff9700 1 -- 172.21.15.26:0/547462095 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f70b801b400 con 0x7f70d01591b0 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.768+0000 7f70ccff9700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f70b0067330 0x7f70b00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.768+0000 7f70ccff9700 1 -- 172.21.15.26:0/547462095 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f70b80846f0 con 0x7f70d01591b0 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.768+0000 7f70cffff700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f70b0067330 0x7f70b00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:34.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.769+0000 7f70cffff700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f70b0067330 0x7f70b00697e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f70d00b2160 tx=0x7f70c0019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:34.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.772+0000 7f70ccff9700 1 -- 172.21.15.26:0/547462095 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f70b8051670 con 0x7f70d01591b0 2023-09-28T00:15:34.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.965+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70d0064050 con 0x7f70d01591b0 2023-09-28T00:15:34.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.966+0000 7f70ccff9700 1 -- 172.21.15.26:0/547462095 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f70b80076f0 con 0x7f70d01591b0 2023-09-28T00:15:34.967 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:34.967 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:30.373905+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:34.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f70b0067330 msgr2=0x7f70b00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f70b0067330 0x7f70b00697e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f70d00b2160 tx=0x7f70c0019000 comp rx=0 tx=0).stop 2023-09-28T00:15:34.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70d01591b0 msgr2=0x7f70d015c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:34.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70d01591b0 0x7f70d015c550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70b800c790 tx=0x7f70b8007ea0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 shutdown_connections 2023-09-28T00:15:34.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f70b0067330 0x7f70b00697e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70d015d930 0x7f70d0147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70d01591b0 0x7f70d015c550 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 --2- 172.21.15.26:0/547462095 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70d015d560 0x7f70d00c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:34.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 >> 172.21.15.26:0/547462095 conn(0x7f70d00d1180 msgr2=0x7f70d00b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:34.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 shutdown_connections 2023-09-28T00:15:34.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:34.968+0000 7f70d7115700 1 -- 172.21.15.26:0/547462095 wait complete. 2023-09-28T00:15:34.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-28T00:15:34.982 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-28T00:15:34.982 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-28T00:15:34.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-28T00:15:34.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-09-28T00:15:34.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-09-28T00:15:34.984 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-09-28T00:15:34.984 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-09-28T00:15:35.057 INFO:tasks.ceph.mds.d.smithi190.stderr:2023-09-28T00:15:35.056+0000 7f3c28989700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-28T00:15:35.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.191+0000 7fd6a9be4700 1 Processor -- start 2023-09-28T00:15:35.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.191+0000 7fd6a9be4700 1 -- start start 2023-09-28T00:15:35.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.191+0000 7f690697c700 1 Processor -- start 2023-09-28T00:15:35.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.192+0000 7f690697c700 1 -- start start 2023-09-28T00:15:35.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.192+0000 7f812f29a700 1 Processor -- start 2023-09-28T00:15:35.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7f690697c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f690015db60 0x7f690006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7f690697c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69000af750 0x7f690006b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7f690697c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69000b1d90 con 0x7f690015df30 2023-09-28T00:15:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7f690697c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69000afb50 con 0x7f69000af750 2023-09-28T00:15:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7f690697c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69000b1460 con 0x7f690015db60 2023-09-28T00:15:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7fd6a9be4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd6a40ab3b0 0x7fd6a4156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7fd6a9be4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6a40cbd50 0x7fd6a4156760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7fd6a9be4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a40adf70 con 0x7fd6a40cb980 2023-09-28T00:15:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7fd6a9be4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a40b0e00 con 0x7fd6a40cbd50 2023-09-28T00:15:35.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7fd6a9be4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a40ad360 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7fd6a3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6a40cbd50 0x7fd6a4156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7fd6a3fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6a40cbd50 0x7fd6a4156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46430/0 (socket says 172.21.15.26:46430) 2023-09-28T00:15:35.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7fd6a3fff700 1 -- 172.21.15.26:0/926570499 learned_addr learned my addr 172.21.15.26:0/926570499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f68fffff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f690015db60 0x7f690006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f68fffff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f690015db60 0x7f690006abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:38136/0 (socket says 172.21.15.26:38136) 2023-09-28T00:15:35.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f68fffff700 1 -- 172.21.15.26:0/1835257870 learned_addr learned my addr 172.21.15.26:0/1835257870 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7fd6a2ffd700 1 --2- 172.21.15.26:0/926570499 >> v2:172.21.15.190:3300/0 conn(0x7fd6a40ab3b0 0x7fd6a4156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7fd6a3fff700 1 -- 172.21.15.26:0/926570499 >> v2:172.21.15.190:3300/0 conn(0x7fd6a40ab3b0 msgr2=0x7fd6a4156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7fd6a3fff700 1 --2- 172.21.15.26:0/926570499 >> v2:172.21.15.190:3300/0 conn(0x7fd6a40ab3b0 0x7fd6a4156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7fd6a3fff700 1 -- 172.21.15.26:0/926570499 >> v1:172.21.15.26:6789/0 conn(0x7fd6a40cb980 legacy=0x7fd6a40ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7fd6a3fff700 1 -- 172.21.15.26:0/926570499 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a40ad640 con 0x7fd6a40cbd50 2023-09-28T00:15:35.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.193+0000 7f812f29a700 1 -- start start 2023-09-28T00:15:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f812f29a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f812806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f812f29a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81280b1d90 con 0x7f81280af750 2023-09-28T00:15:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f812f29a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81280b1460 con 0x7f812815df30 2023-09-28T00:15:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f812f29a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81280afb50 con 0x7f812815db60 2023-09-28T00:15:35.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7fd6a3fff700 1 --2- 172.21.15.26:0/926570499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a40cbd50 0x7fd6a4156760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40b2350 tx=0x7fd69c0082d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2a4ee0d499b8ac server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f68fffff700 1 -- 172.21.15.26:0/1835257870 >> v2:172.21.15.26:3300/0 conn(0x7f69000af750 msgr2=0x7f690006b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f68fffff700 1 --2- 172.21.15.26:0/1835257870 >> v2:172.21.15.26:3300/0 conn(0x7f69000af750 0x7f690006b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f68fffff700 1 -- 172.21.15.26:0/1835257870 >> v1:172.21.15.190:6789/0 conn(0x7f690015df30 legacy=0x7f69000af040 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T00:15:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f68fffff700 1 -- 172.21.15.26:0/1835257870 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69000b1740 con 0x7f690015db60 2023-09-28T00:15:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f812d036700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f812806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f812c835700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f812815df30 0x7f81280af040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:48618/0 (socket says 172.21.15.26:48618) 2023-09-28T00:15:35.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f812c835700 1 -- 172.21.15.26:0/3801087613 learned_addr learned my addr 172.21.15.26:0/3801087613 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f68fffff700 1 --2- 172.21.15.26:0/1835257870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690015db60 0x7f690006abd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f690006d0b0 tx=0x7f68f0009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a297eeeebf3aca2 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7fd6a27fc700 1 -- 172.21.15.26:0/926570499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c010070 con 0x7fd6a40cbd50 2023-09-28T00:15:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7fd6a27fc700 1 -- 172.21.15.26:0/926570499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c00da10 con 0x7fd6a40cbd50 2023-09-28T00:15:35.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7fd6a27fc700 1 -- 172.21.15.26:0/926570499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00ddb0 con 0x7fd6a40cbd50 2023-09-28T00:15:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f812d036700 1 -- 172.21.15.26:0/3801087613 >> v1:172.21.15.190:6789/0 conn(0x7f812815df30 legacy=0x7f81280af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f812d036700 1 -- 172.21.15.26:0/3801087613 >> v1:172.21.15.26:6789/0 conn(0x7f81280af750 legacy=0x7f812815f550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:15:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f812d036700 1 -- 172.21.15.26:0/3801087613 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81280b1740 con 0x7f812815db60 2023-09-28T00:15:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f575d7b8700 1 Processor -- start 2023-09-28T00:15:35.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.194+0000 7f575d7b8700 1 -- start start 2023-09-28T00:15:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f575d7b8700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f575815db60 0x7f575806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f575d7b8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f575815df30 0x7f575806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f575d7b8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57580b1d90 con 0x7f57580af040 2023-09-28T00:15:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f575d7b8700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57580b1460 con 0x7f575815db60 2023-09-28T00:15:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.195+0000 7f575d7b8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57580b1740 con 0x7f575815df30 2023-09-28T00:15:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5756ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f575815db60 0x7f575806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5756ffd700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f575815db60 0x7f575806abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:38146/0 (socket says 172.21.15.26:38146) 2023-09-28T00:15:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5756ffd700 1 -- 172.21.15.26:0/3486155271 learned_addr learned my addr 172.21.15.26:0/3486155271 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f77fc3a8700 1 Processor -- start 2023-09-28T00:15:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f77fc3a8700 1 -- start start 2023-09-28T00:15:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f68feffd700 1 -- 172.21.15.26:0/1835257870 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0005c10 con 0x7f690015db60 2023-09-28T00:15:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f68feffd700 1 -- 172.21.15.26:0/1835257870 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0005d70 con 0x7f690015db60 2023-09-28T00:15:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f68feffd700 1 -- 172.21.15.26:0/1835257870 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000b840 con 0x7f690015db60 2023-09-28T00:15:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5756ffd700 1 -- 172.21.15.26:0/3486155271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f575815df30 msgr2=0x7f575806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5756ffd700 1 --2- 172.21.15.26:0/3486155271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f575815df30 0x7f575806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5756ffd700 1 -- 172.21.15.26:0/3486155271 >> v1:172.21.15.26:6789/0 conn(0x7f57580af040 legacy=0x7f57580af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5756ffd700 1 -- 172.21.15.26:0/3486155271 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57580b1a20 con 0x7f575815db60 2023-09-28T00:15:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7fd6a9be4700 1 -- 172.21.15.26:0/926570499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a40cbd50 msgr2=0x7fd6a4156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7fd6a9be4700 1 --2- 172.21.15.26:0/926570499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a40cbd50 0x7fd6a4156760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6a40b2350 tx=0x7fd69c0082d0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f812d036700 1 --2- 172.21.15.26:0/3801087613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f812806abd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8120009ee0 tx=0x7f8120009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d8c2869c33459ca server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5756ffd700 1 --2- 172.21.15.26:0/3486155271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f575815db60 0x7f575806abd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5748009990 tx=0x7f5748009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd960874b3b5728b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5a72756700 1 Processor -- start 2023-09-28T00:15:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7ffb523c9700 1 Processor -- start 2023-09-28T00:15:35.205 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7fd6a9be4700 1 -- 172.21.15.26:0/926570499 shutdown_connections 2023-09-28T00:15:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7fd6a9be4700 1 --2- 172.21.15.26:0/926570499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a40cbd50 0x7fd6a4156760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7fd6a9be4700 1 --2- 172.21.15.26:0/926570499 >> v2:172.21.15.190:3300/0 conn(0x7fd6a40ab3b0 0x7fd6a4156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7fd6a9be4700 1 -- 172.21.15.26:0/926570499 >> 172.21.15.26:0/926570499 conn(0x7fd6a4068b90 msgr2=0x7fd6a40694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f811ffff700 1 -- 172.21.15.26:0/3801087613 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812000e070 con 0x7f812815db60 2023-09-28T00:15:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f811ffff700 1 -- 172.21.15.26:0/3801087613 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812000bc10 con 0x7f812815db60 2023-09-28T00:15:35.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7fd6a9be4700 1 -- 172.21.15.26:0/926570499 shutdown_connections 2023-09-28T00:15:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f77fc3a8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f77f40a6b10 0x7f77f40acb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f77fc3a8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f40ae950 con 0x7f77f40a6ee0 2023-09-28T00:15:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f77fc3a8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f40cbb50 con 0x7f77f40cb6b0 2023-09-28T00:15:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f77fc3a8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f415b2e0 con 0x7f77f40a6b10 2023-09-28T00:15:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f77fa945700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f77f40cb6b0 0x7f77f40b1350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:48628/0 (socket says 172.21.15.26:48628) 2023-09-28T00:15:35.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f77fa945700 1 -- 172.21.15.26:0/3209459786 learned_addr learned my addr 172.21.15.26:0/3209459786 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7ffb523c9700 1 -- start start 2023-09-28T00:15:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f5a72756700 1 -- start start 2023-09-28T00:15:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f5a72756700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5a6c159500 0x7f5a6c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f5a72756700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5a6c0b3fd0 0x7f5a6c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a72756700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6c15dd20 con 0x7f5a6c15d8e0 2023-09-28T00:15:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a72756700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c0b1110 con 0x7f5a6c159500 2023-09-28T00:15:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a72756700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a6c0b13b0 con 0x7f5a6c0b3fd0 2023-09-28T00:15:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f811ffff700 1 -- 172.21.15.26:0/3801087613 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120012430 con 0x7f812815db60 2023-09-28T00:15:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f812f29a700 1 -- 172.21.15.26:0/3801087613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 msgr2=0x7f812806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f812f29a700 1 --2- 172.21.15.26:0/3801087613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f812806abd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8120009ee0 tx=0x7f8120009780 comp rx=0 tx=0).stop 2023-09-28T00:15:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb523c9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dad0 0x7ffb4c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb523c9700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffb4c15dea0 0x7ffb4c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb523c9700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb4c0af0b0 0x7ffb4c0af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb523c9700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4c0ac7f0 con 0x7ffb4c0af0b0 2023-09-28T00:15:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb523c9700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4c0abbe0 con 0x7ffb4c15dea0 2023-09-28T00:15:35.210 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb523c9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0abec0 con 0x7ffb4c15dad0 2023-09-28T00:15:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f812f29a700 1 -- 172.21.15.26:0/3801087613 shutdown_connections 2023-09-28T00:15:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f812f29a700 1 --2- 172.21.15.26:0/3801087613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f812806abd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f812f29a700 1 -- 172.21.15.26:0/3801087613 >> 172.21.15.26:0/3801087613 conn(0x7f8128068b90 msgr2=0x7f81280694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a6b7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5a6c0b3fd0 0x7f5a6c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f690697c700 1 -- 172.21.15.26:0/1835257870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690015db60 msgr2=0x7f690006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f690697c700 1 --2- 172.21.15.26:0/1835257870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690015db60 0x7f690006abd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f690006d0b0 tx=0x7f68f0009220 comp rx=0 tx=0).stop 2023-09-28T00:15:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a6b7fe700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5a6c0b3fd0 0x7f5a6c15d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:38158/0 (socket says 172.21.15.26:38158) 2023-09-28T00:15:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a6b7fe700 1 -- 172.21.15.26:0/3347230449 learned_addr learned my addr 172.21.15.26:0/3347230449 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.196+0000 7f57567fc700 1 -- 172.21.15.26:0/3486155271 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748005c10 con 0x7f575815db60 2023-09-28T00:15:35.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f57567fc700 1 -- 172.21.15.26:0/3486155271 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748005d70 con 0x7f575815db60 2023-09-28T00:15:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7f57567fc700 1 -- 172.21.15.26:0/3486155271 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574800b860 con 0x7f575815db60 2023-09-28T00:15:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f575d7b8700 1 -- 172.21.15.26:0/3486155271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f575815db60 msgr2=0x7f575806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f575d7b8700 1 --2- 172.21.15.26:0/3486155271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f575815db60 0x7f575806abd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5748009990 tx=0x7f5748009220 comp rx=0 tx=0).stop 2023-09-28T00:15:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f690697c700 1 -- 172.21.15.26:0/1835257870 shutdown_connections 2023-09-28T00:15:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f690697c700 1 --2- 172.21.15.26:0/1835257870 >> v2:172.21.15.26:3300/0 conn(0x7f69000af750 0x7f690006b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f690697c700 1 --2- 172.21.15.26:0/1835257870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690015db60 0x7f690006abd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f690697c700 1 -- 172.21.15.26:0/1835257870 >> 172.21.15.26:0/1835257870 conn(0x7f6900068b90 msgr2=0x7f69000694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a6b7fe700 1 -- 172.21.15.26:0/3347230449 >> v2:172.21.15.26:3300/0 conn(0x7f5a6c159500 msgr2=0x7f5a6c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a6b7fe700 1 --2- 172.21.15.26:0/3347230449 >> v2:172.21.15.26:3300/0 conn(0x7f5a6c159500 0x7f5a6c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a6b7fe700 1 -- 172.21.15.26:0/3347230449 >> v1:172.21.15.190:6789/0 conn(0x7f5a6c15d8e0 legacy=0x7f5a6c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f5a6b7fe700 1 -- 172.21.15.26:0/3347230449 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c0b1690 con 0x7f5a6c0b3fd0 2023-09-28T00:15:35.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f812f29a700 1 -- 172.21.15.26:0/3801087613 shutdown_connections 2023-09-28T00:15:35.214 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb4bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dad0 0x7ffb4c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb4bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dad0 0x7ffb4c06e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34496/0 (socket says 172.21.15.26:34496) 2023-09-28T00:15:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb4bfff700 1 -- 172.21.15.26:0/2033255293 learned_addr learned my addr 172.21.15.26:0/2033255293 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7ffb4b7fe700 1 --2- 172.21.15.26:0/2033255293 >> v2:172.21.15.190:3300/0 conn(0x7ffb4c15dea0 0x7ffb4c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f575d7b8700 1 -- 172.21.15.26:0/3486155271 shutdown_connections 2023-09-28T00:15:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f575d7b8700 1 --2- 172.21.15.26:0/3486155271 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f575815db60 0x7f575806abd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f575d7b8700 1 --2- 172.21.15.26:0/3486155271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f575815df30 0x7f575806b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f575d7b8700 1 -- 172.21.15.26:0/3486155271 >> 172.21.15.26:0/3486155271 conn(0x7f5758068b90 msgr2=0x7f57580694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.215 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f575d7b8700 1 -- 172.21.15.26:0/3486155271 shutdown_connections 2023-09-28T00:15:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498541007 0 0) 0x7f77f40cbb50 con 0x7f77f40cb6b0 2023-09-28T00:15:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e0003570 con 0x7f77f40cb6b0 2023-09-28T00:15:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4132804908 0 0) 0x7f77e0003570 con 0x7f77f40cb6b0 2023-09-28T00:15:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 >> v2:172.21.15.26:3300/0 conn(0x7f77f40a6b10 msgr2=0x7f77f40acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f77f9142700 1 --2- 172.21.15.26:0/3209459786 >> v2:172.21.15.26:3300/0 conn(0x7f77f40a6b10 0x7f77f40acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 >> v1:172.21.15.26:6789/0 conn(0x7f77f40a6ee0 legacy=0x7f77f40ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.216 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f40b1160 con 0x7f77f40cb6b0 2023-09-28T00:15:35.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.197+0000 7fd6a9be4700 1 -- 172.21.15.26:0/926570499 wait complete. 2023-09-28T00:15:35.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f5a6b7fe700 1 --2- 172.21.15.26:0/3347230449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a6c0b3fd0 0x7f5a6c15d3a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c063430 tx=0x7f5a5c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f7df7db10679cc server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7f77ec0017f0 con 0x7f77f40cb6b0 2023-09-28T00:15:35.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 >> v1:172.21.15.190:6789/0 conn(0x7f77f40cb6b0 legacy=0x7f77f40b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 --2- 172.21.15.26:0/3209459786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e0003a60 0x7f77e0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 --2- 172.21.15.26:0/3209459786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77e0004810 0x7f77e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 --2- 172.21.15.26:0/3209459786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e00053c0 0x7f77e000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f415b2e0 con 0x7f77e0003a60 2023-09-28T00:15:35.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e000c250 con 0x7f77e00053c0 2023-09-28T00:15:35.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e000c410 con 0x7f77e0004810 2023-09-28T00:15:35.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7fd6a9be4700 1 Processor -- start 2023-09-28T00:15:35.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7ffb4b7fe700 1 -- 172.21.15.26:0/2033255293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dad0 msgr2=0x7ffb4c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7ffb4b7fe700 1 --2- 172.21.15.26:0/2033255293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dad0 0x7ffb4c06e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7ffb4b7fe700 1 -- 172.21.15.26:0/2033255293 >> v2:172.21.15.26:3300/0 conn(0x7ffb4c0af0b0 msgr2=0x7ffb4c0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7ffb4b7fe700 1 --2- 172.21.15.26:0/2033255293 >> v2:172.21.15.26:3300/0 conn(0x7ffb4c0af0b0 0x7ffb4c0af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7ffb4b7fe700 1 -- 172.21.15.26:0/2033255293 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c0ac1a0 con 0x7ffb4c15dea0 2023-09-28T00:15:35.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f5a6affd700 1 -- 172.21.15.26:0/3347230449 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00b860 con 0x7f5a6c0b3fd0 2023-09-28T00:15:35.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f575d7b8700 1 -- 172.21.15.26:0/3486155271 wait complete. 2023-09-28T00:15:35.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f5a6affd700 1 -- 172.21.15.26:0/3347230449 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c00b9c0 con 0x7f5a6c0b3fd0 2023-09-28T00:15:35.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f5a6affd700 1 -- 172.21.15.26:0/3347230449 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c00bd60 con 0x7f5a6c0b3fd0 2023-09-28T00:15:35.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7ffb4b7fe700 1 --2- 172.21.15.26:0/2033255293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dea0 0x7ffb4c06eb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c06d010 tx=0x7ffb400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a345db7471808032 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7ffb4affd700 1 -- 172.21.15.26:0/2033255293 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000b6b0 con 0x7ffb4c15dea0 2023-09-28T00:15:35.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7ffb4affd700 1 -- 172.21.15.26:0/2033255293 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4000b810 con 0x7ffb4c15dea0 2023-09-28T00:15:35.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7ffb4affd700 1 -- 172.21.15.26:0/2033255293 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000bbb0 con 0x7ffb4c15dea0 2023-09-28T00:15:35.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f5a72756700 1 -- 172.21.15.26:0/3347230449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a6c0b3fd0 msgr2=0x7f5a6c15d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f5a72756700 1 --2- 172.21.15.26:0/3347230449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a6c0b3fd0 0x7f5a6c15d3a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c063430 tx=0x7f5a5c009250 comp rx=0 tx=0).stop 2023-09-28T00:15:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f77fa945700 1 --2- 172.21.15.26:0/3209459786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e00053c0 0x7f77e000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f77fa945700 1 -- 172.21.15.26:0/3209459786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77e0004810 msgr2=0x7f77e0004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:15:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f77fa945700 1 --2- 172.21.15.26:0/3209459786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77e0004810 0x7f77e0004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f77fa945700 1 -- 172.21.15.26:0/3209459786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e0003a60 msgr2=0x7f77e0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f77fa945700 1 --2- 172.21.15.26:0/3209459786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77e0003a60 0x7f77e0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f77fa945700 1 -- 172.21.15.26:0/3209459786 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0003570 con 0x7f77e00053c0 2023-09-28T00:15:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f77fa945700 1 -- 172.21.15.26:0/3209459786 reap_dead start 2023-09-28T00:15:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f5a72756700 1 -- 172.21.15.26:0/3347230449 shutdown_connections 2023-09-28T00:15:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f5a72756700 1 --2- 172.21.15.26:0/3347230449 >> v2:172.21.15.26:3300/0 conn(0x7f5a6c159500 0x7f5a6c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f5a72756700 1 --2- 172.21.15.26:0/3347230449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a6c0b3fd0 0x7f5a6c15d3a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f5a72756700 1 -- 172.21.15.26:0/3347230449 >> 172.21.15.26:0/3347230449 conn(0x7f5a6c067630 msgr2=0x7f5a6c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f77fa945700 1 --2- 172.21.15.26:0/3209459786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e00053c0 0x7f77e000ba60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00a950 tx=0x7f77ec0021f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab39335043cd81f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.198+0000 7f812f29a700 1 -- 172.21.15.26:0/3801087613 wait complete. 2023-09-28T00:15:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f812f29a700 1 Processor -- start 2023-09-28T00:15:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f812f29a700 1 -- start start 2023-09-28T00:15:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0070d0 con 0x7f77e00053c0 2023-09-28T00:15:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec007270 con 0x7f77e00053c0 2023-09-28T00:15:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7f77f9142700 1 -- 172.21.15.26:0/3209459786 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec007630 con 0x7f77e00053c0 2023-09-28T00:15:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7fd6a9be4700 1 -- start start 2023-09-28T00:15:35.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7fd6a9be4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a40ab3b0 0x7fd6a41557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7fd6a9be4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a40cb980 0x7fd6a415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7fd6a9be4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a40cbd50 0x7fd6a415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7fd6a9be4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4176f60 con 0x7fd6a40cbd50 2023-09-28T00:15:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7fd6a9be4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4176970 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7fd6a9be4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a415e230 con 0x7fd6a40cb980 2023-09-28T00:15:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7fd6a37fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a40ab3b0 0x7fd6a41557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7fd6a37fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a40ab3b0 0x7fd6a41557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:38184/0 (socket says 172.21.15.26:38184) 2023-09-28T00:15:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7fd6a37fe700 1 -- 172.21.15.26:0/3458390406 learned_addr learned my addr 172.21.15.26:0/3458390406 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7ffb523c9700 1 -- 172.21.15.26:0/2033255293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dea0 msgr2=0x7ffb4c06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7ffb523c9700 1 --2- 172.21.15.26:0/2033255293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dea0 0x7ffb4c06eb50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c06d010 tx=0x7ffb400091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7ffb523c9700 1 -- 172.21.15.26:0/2033255293 shutdown_connections 2023-09-28T00:15:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7ffb523c9700 1 --2- 172.21.15.26:0/2033255293 >> v2:172.21.15.26:3300/0 conn(0x7ffb4c0af0b0 0x7ffb4c0af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7ffb523c9700 1 --2- 172.21.15.26:0/2033255293 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dad0 0x7ffb4c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7ffb523c9700 1 --2- 172.21.15.26:0/2033255293 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dea0 0x7ffb4c06eb50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7ffb523c9700 1 -- 172.21.15.26:0/2033255293 >> 172.21.15.26:0/2033255293 conn(0x7ffb4c0680b0 msgr2=0x7ffb4c0684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7ffb523c9700 1 -- 172.21.15.26:0/2033255293 shutdown_connections 2023-09-28T00:15:35.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7f575d7b8700 1 Processor -- start 2023-09-28T00:15:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7f5a72756700 1 -- 172.21.15.26:0/3347230449 shutdown_connections 2023-09-28T00:15:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7ffb523c9700 1 -- 172.21.15.26:0/2033255293 wait complete. 2023-09-28T00:15:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7fd6a37fe700 1 -- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a40cb980 msgr2=0x7fd6a415d4b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-28T00:15:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7fd6a37fe700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a40cb980 0x7fd6a415d4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7fd6a37fe700 1 -- 172.21.15.26:0/3458390406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a40cbd50 msgr2=0x7fd6a415d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7fd6a37fe700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a40cbd50 0x7fd6a415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7fd6a37fe700 1 -- 172.21.15.26:0/3458390406 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c008570 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7fd6a37fe700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a40ab3b0 0x7fd6a41557a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00b7e0 tx=0x7fd68c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7fd69b7fe700 1 -- 172.21.15.26:0/3458390406 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00f510 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7f77fc3a8700 1 -- 172.21.15.26:0/3209459786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e00053c0 msgr2=0x7f77e000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7f77fc3a8700 1 --2- 172.21.15.26:0/3209459786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e00053c0 0x7f77e000ba60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f77ec00a950 tx=0x7f77ec0021f0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7fd69b7fe700 1 -- 172.21.15.26:0/3458390406 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c00f670 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7fd69b7fe700 1 -- 172.21.15.26:0/3458390406 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c00fa30 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812f29a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81280af750 0x7f81280cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812f29a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f81280cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812f29a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812815df30 0x7f8128096a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812f29a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81281808c0 con 0x7f812815df30 2023-09-28T00:15:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812f29a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81280c8bf0 con 0x7f81280af750 2023-09-28T00:15:35.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812f29a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81281805e0 con 0x7f812815db60 2023-09-28T00:15:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a415e510 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a415df30 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812c835700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f81280cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812d036700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81280af750 0x7f81280cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812c835700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f81280cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34522/0 (socket says 172.21.15.26:34522) 2023-09-28T00:15:35.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812c835700 1 -- 172.21.15.26:0/479270072 learned_addr learned my addr 172.21.15.26:0/479270072 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812c835700 1 -- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81280af750 msgr2=0x7f81280cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812c835700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f81280af750 0x7f81280cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812c835700 1 -- 172.21.15.26:0/479270072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812815df30 msgr2=0x7f8128096a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812c835700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f812815df30 0x7f8128096a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f812c835700 1 -- 172.21.15.26:0/479270072 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8120009a20 con 0x7f812815db60 2023-09-28T00:15:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7f575d7b8700 1 -- start start 2023-09-28T00:15:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f575d7b8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57580af040 0x7f575814a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f575d7b8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f575815db60 0x7f57580aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f575d7b8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f575815df30 0x7f57580aa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f575d7b8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575814a890 con 0x7f57580af040 2023-09-28T00:15:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f575d7b8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57580a8690 con 0x7f575815df30 2023-09-28T00:15:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f575d7b8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57580a7ac0 con 0x7f575815db60 2023-09-28T00:15:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f574e7fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f575815db60 0x7f57580aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f574e7fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f575815db60 0x7f57580aa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34526/0 (socket says 172.21.15.26:34526) 2023-09-28T00:15:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f57577fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f575815df30 0x7f57580aa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f574e7fc700 1 -- 172.21.15.26:0/1548391119 learned_addr learned my addr 172.21.15.26:0/1548391119 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f812c835700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f81280cb0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f811800c7f0 tx=0x7f8118007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7ffb523c9700 1 Processor -- start 2023-09-28T00:15:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f5756ffd700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57580af040 0x7f575814a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f5a72756700 1 -- 172.21.15.26:0/3347230449 wait complete. 2023-09-28T00:15:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f57577fe700 1 -- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f575815db60 msgr2=0x7f57580aa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f57577fe700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f575815db60 0x7f57580aa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f57577fe700 1 -- 172.21.15.26:0/1548391119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57580af040 msgr2=0x7f575814a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f57577fe700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f57580af040 0x7f575814a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f57577fe700 1 -- 172.21.15.26:0/1548391119 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748009480 con 0x7f575815df30 2023-09-28T00:15:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f57577fe700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f575815df30 0x7f57580aa7f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f575000c830 tx=0x7f5750001690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f574f7fe700 1 -- 172.21.15.26:0/1548391119 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750012630 con 0x7f575815df30 2023-09-28T00:15:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f574f7fe700 1 -- 172.21.15.26:0/1548391119 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750012790 con 0x7f575815df30 2023-09-28T00:15:35.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57580a7d60 con 0x7f575815df30 2023-09-28T00:15:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f5a72756700 1 Processor -- start 2023-09-28T00:15:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f574f7fe700 1 -- 172.21.15.26:0/1548391119 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750012b50 con 0x7f575815df30 2023-09-28T00:15:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57580a8320 con 0x7f575815df30 2023-09-28T00:15:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f811d7fa700 1 -- 172.21.15.26:0/479270072 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118005b30 con 0x7f812815db60 2023-09-28T00:15:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f811d7fa700 1 -- 172.21.15.26:0/479270072 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8118005cb0 con 0x7f812815db60 2023-09-28T00:15:35.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f811d7fa700 1 -- 172.21.15.26:0/479270072 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8118004a80 con 0x7f812815db60 2023-09-28T00:15:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81280c85a0 con 0x7f812815db60 2023-09-28T00:15:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8128180a50 con 0x7f812815db60 2023-09-28T00:15:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7ffb523c9700 1 -- start start 2023-09-28T00:15:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7ffb523c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c0af0b0 0x7ffb4c176c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7ffb523c9700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dad0 0x7ffb4c0a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7ffb523c9700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dea0 0x7ffb4c06d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7ffb523c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0a9400 con 0x7ffb4c0af0b0 2023-09-28T00:15:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7ffb523c9700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0a96e0 con 0x7ffb4c15dad0 2023-09-28T00:15:35.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7ffb523c9700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c0a99c0 con 0x7ffb4c15dea0 2023-09-28T00:15:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7f77fc3a8700 1 -- 172.21.15.26:0/3209459786 shutdown_connections 2023-09-28T00:15:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7f77fc3a8700 1 --2- 172.21.15.26:0/3209459786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77e00053c0 0x7f77e000ba60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7f77fc3a8700 1 -- 172.21.15.26:0/3209459786 >> 172.21.15.26:0/3209459786 conn(0x7f77f4068b90 msgr2=0x7f77f40694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6a4064050 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7fd69b7fe700 1 -- 172.21.15.26:0/3458390406 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd68c01a400 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7fd69b7fe700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd684067330 0x7fd6840697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7fd69b7fe700 1 -- 172.21.15.26:0/3458390406 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd68c0550e0 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7f5a72756700 1 -- start start 2023-09-28T00:15:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7ffb4b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dad0 0x7ffb4c0a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7ffb4b7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dad0 0x7ffb4c0a8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:38204/0 (socket says 172.21.15.26:38204) 2023-09-28T00:15:35.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7ffb4b7fe700 1 -- 172.21.15.26:0/3184255327 learned_addr learned my addr 172.21.15.26:0/3184255327 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81280c8400 con 0x7f812815db60 2023-09-28T00:15:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7ffb50966700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dea0 0x7ffb4c06d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7fd69b7fe700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7fd68406fbe0 0x7fd684071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7fd69b7fe700 1 -- 172.21.15.26:0/3458390406 --> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6840726a0 con 0x7fd68406fbe0 2023-09-28T00:15:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7fd69b7fe700 1 -- 172.21.15.26:0/3458390406 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd68c050d20 con 0x7fd6a40ab3b0 2023-09-28T00:15:35.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.205+0000 7fd6a2ffd700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd684067330 0x7fd6840697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7fd6a3fff700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7fd68406fbe0 0x7fd684071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.199+0000 7f690697c700 1 -- 172.21.15.26:0/1835257870 shutdown_connections 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.200+0000 7f690697c700 1 -- 172.21.15.26:0/1835257870 wait complete. 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.201+0000 7f690697c700 1 Processor -- start 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.202+0000 7f690697c700 1 -- start start 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f690697c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69000af750 0x7f690015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f690697c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690015db60 0x7f6900097ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f690697c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690015df30 0x7f6900098e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f690697c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6900187b90 con 0x7f69000af750 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f690697c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6900186af0 con 0x7f690015df30 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f690697c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6900186dd0 con 0x7f690015db60 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f68fffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69000af750 0x7f690015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f68fffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69000af750 0x7f690015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46494/0 (socket says 172.21.15.26:46494) 2023-09-28T00:15:35.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.203+0000 7f68fffff700 1 -- 172.21.15.26:0/894888832 learned_addr learned my addr 172.21.15.26:0/894888832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f68fffff700 1 -- 172.21.15.26:0/894888832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690015db60 msgr2=0x7f6900097ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f68fffff700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f690015db60 0x7f6900097ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f68fffff700 1 -- 172.21.15.26:0/894888832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690015df30 msgr2=0x7f6900098e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f68fffff700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f690015df30 0x7f6900098e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f68fffff700 1 -- 172.21.15.26:0/894888832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f0009480 con 0x7f69000af750 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f68fffff700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69000af750 0x7f690015baa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009260 tx=0x7f68f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f68e7fff700 1 -- 172.21.15.26:0/894888832 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0011ae0 con 0x7f69000af750 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f68e7fff700 1 -- 172.21.15.26:0/894888832 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f0011c40 con 0x7f69000af750 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f68e7fff700 1 -- 172.21.15.26:0/894888832 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f001d430 con 0x7f69000af750 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69001870b0 con 0x7f69000af750 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.204+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6900187670 con 0x7f69000af750 2023-09-28T00:15:35.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68e0000fd0 con 0x7f69000af750 2023-09-28T00:15:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7ffb4b7fe700 1 -- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dea0 msgr2=0x7ffb4c06d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7ffb4b7fe700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb4c15dea0 0x7ffb4c06d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7ffb4b7fe700 1 -- 172.21.15.26:0/3184255327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c0af0b0 msgr2=0x7ffb4c176c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7ffb4b7fe700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb4c0af0b0 0x7ffb4c176c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7ffb4b7fe700 1 -- 172.21.15.26:0/3184255327 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb40009420 con 0x7ffb4c15dad0 2023-09-28T00:15:35.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f5a72756700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a6c0b3fd0 0x7f5a6c14f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f5a72756700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a6c159500 0x7f5a6c152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f5a72756700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a6c15d8e0 0x7f5a6c0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f5a72756700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c16e4e0 con 0x7f5a6c159500 2023-09-28T00:15:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f5a72756700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c16f300 con 0x7f5a6c15d8e0 2023-09-28T00:15:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f5a72756700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c16e6f0 con 0x7f5a6c0b3fd0 2023-09-28T00:15:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7fd6a3fff700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7fd68406fbe0 0x7fd684071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5758064050 con 0x7f575815df30 2023-09-28T00:15:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7fd6a2ffd700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd684067330 0x7fd6840697e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4179e50 tx=0x7fd69400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f811d7fa700 1 -- 172.21.15.26:0/479270072 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f81180070d0 con 0x7f812815db60 2023-09-28T00:15:35.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f77fc3a8700 1 -- 172.21.15.26:0/3209459786 shutdown_connections 2023-09-28T00:15:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7ffb4b7fe700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dad0 0x7ffb4c0a8b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c06cd30 tx=0x7ffb40017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f77fc3a8700 1 -- 172.21.15.26:0/3209459786 wait complete. 2023-09-28T00:15:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.206+0000 7f5a6bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a6c0b3fd0 0x7f5a6c14f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f5a70cf3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a6c15d8e0 0x7f5a6c0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f5a6bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a6c0b3fd0 0x7f5a6c14f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34544/0 (socket says 172.21.15.26:34544) 2023-09-28T00:15:35.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f5a6bfff700 1 -- 172.21.15.26:0/1263651285 learned_addr learned my addr 172.21.15.26:0/1263651285 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7ffb33fff700 1 -- 172.21.15.26:0/3184255327 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40000d10 con 0x7ffb4c15dad0 2023-09-28T00:15:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7ffb33fff700 1 -- 172.21.15.26:0/3184255327 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4000bb90 con 0x7ffb4c15dad0 2023-09-28T00:15:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7ffb33fff700 1 -- 172.21.15.26:0/3184255327 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40011650 con 0x7ffb4c15dad0 2023-09-28T00:15:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c0a9ca0 con 0x7ffb4c15dad0 2023-09-28T00:15:35.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f5a6b7fe700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a6c159500 0x7f5a6c152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f5a6b7fe700 1 -- 172.21.15.26:0/1263651285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a6c0b3fd0 msgr2=0x7f5a6c14f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f5a6b7fe700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a6c0b3fd0 0x7f5a6c14f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f5a6b7fe700 1 -- 172.21.15.26:0/1263651285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a6c15d8e0 msgr2=0x7f5a6c0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f5a6b7fe700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a6c15d8e0 0x7f5a6c0b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f5a6b7fe700 1 -- 172.21.15.26:0/1263651285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c0094f0 con 0x7f5a6c159500 2023-09-28T00:15:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f811d7fa700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f810c067480 0x7f810c069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f811d7fa700 1 -- 172.21.15.26:0/479270072 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8118083f50 con 0x7f812815db60 2023-09-28T00:15:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f811d7fa700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f810c06fcb0 0x7f810c0720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f811d7fa700 1 -- 172.21.15.26:0/479270072 --> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f810c072770 con 0x7f810c06fcb0 2023-09-28T00:15:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f811d7fa700 1 -- 172.21.15.26:0/479270072 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8118001da0 con 0x7f812815db60 2023-09-28T00:15:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f812d036700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f810c067480 0x7f810c069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c0a9060 con 0x7ffb4c15dad0 2023-09-28T00:15:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7fd69b7fe700 1 -- 172.21.15.26:0/3458390406 <== osd.7 v2:172.21.15.190:6808/90455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd6840726a0 con 0x7fd68406fbe0 2023-09-28T00:15:35.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f5a6b7fe700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a6c159500 0x7f5a6c152760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c013000 tx=0x7f5a5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb2c000fd0 con 0x7ffb4c15dad0 2023-09-28T00:15:35.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f77fc3a8700 1 Processor -- start 2023-09-28T00:15:35.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f812d036700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f810c067480 0x7f810c069930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81200097c0 tx=0x7f8120018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f68e7fff700 1 -- 172.21.15.26:0/894888832 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f68f001d820 con 0x7f69000af750 2023-09-28T00:15:35.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f77fc3a8700 1 -- start start 2023-09-28T00:15:35.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f574f7fe700 1 -- 172.21.15.26:0/1548391119 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f575001a3a0 con 0x7f575815df30 2023-09-28T00:15:35.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.207+0000 7f574f7fe700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5738067480 0x7f5738069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f574f7fe700 1 -- 172.21.15.26:0/1548391119 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5750084d00 con 0x7f575815df30 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f574f7fe700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7f573806fd30 0x7f5738072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f574f7fe700 1 -- 172.21.15.26:0/1548391119 --> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57380727f0 con 0x7f573806fd30 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f574f7fe700 1 -- 172.21.15.26:0/1548391119 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57500872a0 con 0x7f575815df30 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f5756ffd700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5738067480 0x7f5738069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.208+0000 7f574e7fc700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7f573806fd30 0x7f5738072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f574e7fc700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7f573806fd30 0x7f5738072140 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f5a53fff700 1 -- 172.21.15.26:0/1263651285 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c01a450 con 0x7f5a6c159500 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f5a53fff700 1 -- 172.21.15.26:0/1263651285 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5c01a5d0 con 0x7f5a6c159500 2023-09-28T00:15:35.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f5a53fff700 1 -- 172.21.15.26:0/1263651285 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5c01a990 con 0x7f5a6c159500 2023-09-28T00:15:35.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f812d837700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f810c06fcb0 0x7f810c0720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f812d837700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f810c06fcb0 0x7f810c0720c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f68e7fff700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f68ec067480 0x7f68ec069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f68e7fff700 1 -- 172.21.15.26:0/894888832 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f68f00870b0 con 0x7f69000af750 2023-09-28T00:15:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f68e7fff700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f68ec06fd30 0x7f68ec072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f68e7fff700 1 -- 172.21.15.26:0/894888832 --> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68ec0727f0 con 0x7f68ec06fd30 2023-09-28T00:15:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f68e7fff700 1 -- 172.21.15.26:0/894888832 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68f00873e0 con 0x7f69000af750 2023-09-28T00:15:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.209+0000 7f6904f19700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f68ec06fd30 0x7f68ec072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f68ff7fe700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f68ec067480 0x7f68ec069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fc3a8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77e00053c0 0x7f77f4097f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fc3a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77f40aa3f0 0x7f77f40984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fc3a8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f40a72c0 0x7f77f40a7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fc3a8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f41512d0 con 0x7f77f40aa3f0 2023-09-28T00:15:35.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fc3a8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40997e0 con 0x7f77f40a72c0 2023-09-28T00:15:35.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fc3a8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f40a9720 con 0x7f77e00053c0 2023-09-28T00:15:35.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fa144700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77e00053c0 0x7f77f4097f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7ffb33fff700 1 -- 172.21.15.26:0/3184255327 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ffb40011a40 con 0x7ffb4c15dad0 2023-09-28T00:15:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fa144700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77e00053c0 0x7f77f4097f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34552/0 (socket says 172.21.15.26:34552) 2023-09-28T00:15:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fa144700 1 -- 172.21.15.26:0/2922454337 learned_addr learned my addr 172.21.15.26:0/2922454337 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fa945700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f40a72c0 0x7f77f40a7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f811d7fa700 1 -- 172.21.15.26:0/479270072 <== osd.2 v2:172.21.15.26:6800/90240 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f810c072770 con 0x7f810c06fcb0 2023-09-28T00:15:35.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f574f7fe700 1 -- 172.21.15.26:0/1548391119 <== osd.4 v2:172.21.15.190:6800/90454 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f57380727f0 con 0x7f573806fd30 2023-09-28T00:15:35.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f68ff7fe700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f68ec067480 0x7f68ec069930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6900163570 tx=0x7f68f4006c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f6904f19700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f68ec06fd30 0x7f68ec072140 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fa144700 1 -- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f40a72c0 msgr2=0x7f77f40a7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fa144700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77f40a72c0 0x7f77f40a7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fa144700 1 -- 172.21.15.26:0/2922454337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77f40aa3f0 msgr2=0x7f77f40984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fa144700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77f40aa3f0 0x7f77f40984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f77fa144700 1 -- 172.21.15.26:0/2922454337 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f40a7c70 con 0x7f77e00053c0 2023-09-28T00:15:35.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7ffb33fff700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb380673b0 0x7ffb38069860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7ffb33fff700 1 -- 172.21.15.26:0/3184255327 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffb40086fc0 con 0x7ffb4c15dad0 2023-09-28T00:15:35.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.211+0000 7ffb4bfff700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb380673b0 0x7ffb38069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.211+0000 7ffb33fff700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7ffb3806faf0 0x7ffb38071f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.211+0000 7ffb33fff700 1 -- 172.21.15.26:0/3184255327 --> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb380725b0 con 0x7ffb3806faf0 2023-09-28T00:15:35.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.211+0000 7ffb33fff700 1 -- 172.21.15.26:0/3184255327 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb400872f0 con 0x7ffb4c15dad0 2023-09-28T00:15:35.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.211+0000 7ffb4bfff700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb380673b0 0x7ffb38069860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c006d40 tx=0x7ffb3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6c16e9d0 con 0x7f5a6c159500 2023-09-28T00:15:35.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.210+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6c16ef90 con 0x7f5a6c159500 2023-09-28T00:15:35.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.211+0000 7ffb50966700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7ffb3806faf0 0x7ffb38071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.212+0000 7f5756ffd700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5738067480 0x7f5738069930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5748009260 tx=0x7f5748016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.212+0000 7f77fa144700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77e00053c0 0x7f77f4097f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f77f000b590 tx=0x7f77f00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.212+0000 7ffb50966700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7ffb3806faf0 0x7ffb38071f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.212+0000 7f68e7fff700 1 -- 172.21.15.26:0/894888832 <== osd.0 v2:172.21.15.26:6816/90241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f68ec0727f0 con 0x7f68ec06fd30 2023-09-28T00:15:35.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.212+0000 7f77ea7fc700 1 -- 172.21.15.26:0/2922454337 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f000f510 con 0x7f77e00053c0 2023-09-28T00:15:35.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.212+0000 7f77ea7fc700 1 -- 172.21.15.26:0/2922454337 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f000f670 con 0x7f77e00053c0 2023-09-28T00:15:35.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.212+0000 7f77ea7fc700 1 -- 172.21.15.26:0/2922454337 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f000fa10 con 0x7f77e00053c0 2023-09-28T00:15:35.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.212+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f4098b60 con 0x7f77e00053c0 2023-09-28T00:15:35.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.212+0000 7f5a53fff700 1 -- 172.21.15.26:0/1263651285 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5a5c01b430 con 0x7f5a6c159500 2023-09-28T00:15:35.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.213+0000 7f5a53fff700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5a58067400 0x7f5a580698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.213+0000 7f5a53fff700 1 -- 172.21.15.26:0/1263651285 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5a5c086110 con 0x7f5a6c159500 2023-09-28T00:15:35.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.213+0000 7f5a6bfff700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5a58067400 0x7f5a580698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.213+0000 7ffb33fff700 1 -- 172.21.15.26:0/3184255327 <== osd.3 v2:172.21.15.26:6824/90242 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ffb380725b0 con 0x7ffb3806faf0 2023-09-28T00:15:35.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.213+0000 7f5a6bfff700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5a58067400 0x7f5a580698b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009b30 tx=0x7f5a60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.213+0000 7f5a72756700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7f5a6c152ca0 0x7f5a6c1572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.214+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 --> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a6c0b1970 con 0x7f5a6c152ca0 2023-09-28T00:15:35.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.214+0000 7f5a70cf3700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7f5a6c152ca0 0x7f5a6c1572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.214+0000 7f5a70cf3700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7f5a6c152ca0 0x7f5a6c1572a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.215+0000 7f20ed7b3700 1 Processor -- start 2023-09-28T00:15:35.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.215+0000 7f5a53fff700 1 -- 172.21.15.26:0/1263651285 <== osd.1 v2:172.21.15.26:6808/90239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5a6c0b1970 con 0x7f5a6c152ca0 2023-09-28T00:15:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.215+0000 7f20ed7b3700 1 -- start start 2023-09-28T00:15:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20ed7b3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e81553f0 0x7f20e815b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20ed7b3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f20e8068ed0 0x7f20e8069300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20ed7b3700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e81582c0 con 0x7f20e80cc090 2023-09-28T00:15:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20ed7b3700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e80af520 con 0x7f20e8068ed0 2023-09-28T00:15:35.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20ed7b3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e8158e60 con 0x7f20e81553f0 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20e6ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e81553f0 0x7f20e815b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20e6ffd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e81553f0 0x7f20e815b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34560/0 (socket says 172.21.15.26:34560) 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20e6ffd700 1 -- 172.21.15.26:0/1197415915 learned_addr learned my addr 172.21.15.26:0/1197415915 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20e6ffd700 1 -- 172.21.15.26:0/1197415915 >> v2:172.21.15.26:3300/0 conn(0x7f20e8068ed0 msgr2=0x7f20e8069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20e6ffd700 1 --2- 172.21.15.26:0/1197415915 >> v2:172.21.15.26:3300/0 conn(0x7f20e8068ed0 0x7f20e8069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20e6ffd700 1 -- 172.21.15.26:0/1197415915 >> v1:172.21.15.26:6789/0 conn(0x7f20e80cc090 legacy=0x7f20e8158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20e5ffb700 1 -- 172.21.15.26:0/1197415915 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967623869 0 0) 0x7f20e81582c0 con 0x7f20e80cc090 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.217+0000 7f20e6ffd700 1 -- 172.21.15.26:0/1197415915 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e8157fc0 con 0x7f20e81553f0 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.218+0000 7f20e6ffd700 1 --2- 172.21.15.26:0/1197415915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e81553f0 0x7f20e815b4b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0099b0 tx=0x7f20dc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b41adcf7cedca17 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.218+0000 7f20e5ffb700 1 -- 172.21.15.26:0/1197415915 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00b860 con 0x7f20e81553f0 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.218+0000 7f20e5ffb700 1 -- 172.21.15.26:0/1197415915 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20dc00b9c0 con 0x7f20e81553f0 2023-09-28T00:15:35.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.218+0000 7f20e5ffb700 1 -- 172.21.15.26:0/1197415915 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20dc00bd60 con 0x7f20e81553f0 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.219+0000 7f20ed7b3700 1 -- 172.21.15.26:0/1197415915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e81553f0 msgr2=0x7f20e815b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.219+0000 7f20ed7b3700 1 --2- 172.21.15.26:0/1197415915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e81553f0 0x7f20e815b4b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0099b0 tx=0x7f20dc009250 comp rx=0 tx=0).stop 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.219+0000 7f20ed7b3700 1 -- 172.21.15.26:0/1197415915 shutdown_connections 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.219+0000 7f20ed7b3700 1 --2- 172.21.15.26:0/1197415915 >> v2:172.21.15.26:3300/0 conn(0x7f20e8068ed0 0x7f20e8069300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.219+0000 7f20ed7b3700 1 --2- 172.21.15.26:0/1197415915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e81553f0 0x7f20e815b4b0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0099b0 tx=0x7f20dc009250 comp rx=0 tx=0).stop 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.219+0000 7f20ed7b3700 1 -- 172.21.15.26:0/1197415915 >> 172.21.15.26:0/1197415915 conn(0x7f20e806e910 msgr2=0x7f20e806be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.219+0000 7f20ed7b3700 1 -- 172.21.15.26:0/1197415915 shutdown_connections 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.219+0000 7f20ed7b3700 1 -- 172.21.15.26:0/1197415915 wait complete. 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.221+0000 7f20ed7b3700 1 Processor -- start 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.221+0000 7f20ed7b3700 1 -- start start 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.222+0000 7f20ed7b3700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20e8068ed0 0x7f20e80ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.222+0000 7f20ed7b3700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e80cc090 0x7f20e80b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.222+0000 7f20ed7b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e80b26e0 0x7f20e815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.222+0000 7f20ed7b3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80b1470 con 0x7f20e80b26e0 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.222+0000 7f20ed7b3700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80b1d10 con 0x7f20e8068ed0 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.222+0000 7f20ed7b3700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e80b0760 con 0x7f20e80cc090 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f20e67fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e80cc090 0x7f20e80b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f20e67fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e80cc090 0x7f20e80b21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34572/0 (socket says 172.21.15.26:34572) 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f20e67fc700 1 -- 172.21.15.26:0/2008046813 learned_addr learned my addr 172.21.15.26:0/2008046813 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f20e67fc700 1 -- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20e8068ed0 msgr2=0x7f20e80ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f20e67fc700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f20e8068ed0 0x7f20e80ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f20e67fc700 1 -- 172.21.15.26:0/2008046813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e80b26e0 msgr2=0x7f20e815c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f20e67fc700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f20e80b26e0 0x7f20e815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f20e67fc700 1 -- 172.21.15.26:0/2008046813 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0094f0 con 0x7f20e80cc090 2023-09-28T00:15:35.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f20e67fc700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e80cc090 0x7f20e80b21a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c810 tx=0x7f20d8007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.224+0000 7f20ceffd700 1 -- 172.21.15.26:0/2008046813 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8012700 con 0x7f20e80cc090 2023-09-28T00:15:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.224+0000 7f20ceffd700 1 -- 172.21.15.26:0/2008046813 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d8012880 con 0x7f20e80cc090 2023-09-28T00:15:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.224+0000 7f20ceffd700 1 -- 172.21.15.26:0/2008046813 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d8012c40 con 0x7f20e80cc090 2023-09-28T00:15:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.223+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f4099120 con 0x7f77e00053c0 2023-09-28T00:15:35.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.224+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e80b16c0 con 0x7f20e80cc090 2023-09-28T00:15:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.224+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e80addb0 con 0x7f20e80cc090 2023-09-28T00:15:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.225+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20e8064050 con 0x7f20e80cc090 2023-09-28T00:15:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.225+0000 7f77ea7fc700 1 -- 172.21.15.26:0/2922454337 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f77f001a400 con 0x7f77e00053c0 2023-09-28T00:15:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.227+0000 7f20ceffd700 1 -- 172.21.15.26:0/2008046813 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f20d8025430 con 0x7f20e80cc090 2023-09-28T00:15:35.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.226+0000 7f77ea7fc700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f77d8067330 0x7f77d80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.226+0000 7f77f9943700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f77d8067330 0x7f77d80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.226+0000 7f77f9943700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f77d8067330 0x7f77d80697e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77f40cb430 tx=0x7f77e4007b20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.227+0000 7f20ceffd700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f20d4067330 0x7f20d40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.227+0000 7f20ceffd700 1 -- 172.21.15.26:0/2008046813 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f20d8085200 con 0x7f20e80cc090 2023-09-28T00:15:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.228+0000 7f20ceffd700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f20d406fbe0 0x7f20d4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.228+0000 7f20ceffd700 1 -- 172.21.15.26:0/2008046813 --> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20d40726a0 con 0x7f20d406fbe0 2023-09-28T00:15:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.228+0000 7f20ceffd700 1 -- 172.21.15.26:0/2008046813 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f20d80855d0 con 0x7f20e80cc090 2023-09-28T00:15:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.228+0000 7f20e77fe700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f20d406fbe0 0x7f20d4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.228+0000 7f20e77fe700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f20d406fbe0 0x7f20d4071ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.229+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f77f4064050 con 0x7f77e00053c0 2023-09-28T00:15:35.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.229+0000 7f20ceffd700 1 -- 172.21.15.26:0/2008046813 <== osd.5 v2:172.21.15.190:6816/90467 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f20d40726a0 con 0x7f20d406fbe0 2023-09-28T00:15:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.231+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 --> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6a415e6a0 con 0x7fd68406fbe0 2023-09-28T00:15:35.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.232+0000 7fd69b7fe700 1 -- 172.21.15.26:0/3458390406 <== osd.7 v2:172.21.15.190:6808/90455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6a415e6a0 con 0x7fd68406fbe0 2023-09-28T00:15:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.233+0000 7f77ea7fc700 1 -- 172.21.15.26:0/2922454337 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f77f0054f90 con 0x7f77e00053c0 2023-09-28T00:15:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.233+0000 7f77ea7fc700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f77d806fae0 0x7f77d8071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.233+0000 7f77ea7fc700 1 -- 172.21.15.26:0/2922454337 --> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77d80725a0 con 0x7f77d806fae0 2023-09-28T00:15:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.233+0000 7f77ea7fc700 1 -- 172.21.15.26:0/2922454337 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77f0050bd0 con 0x7f77e00053c0 2023-09-28T00:15:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.233+0000 7f77fa945700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f77d806fae0 0x7f77d8071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.233+0000 7f77fa945700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f77d806fae0 0x7f77d8071ef0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.234+0000 7f20e6ffd700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f20d4067330 0x7f20d40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.234+0000 7f20e6ffd700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f20d4067330 0x7f20d40697e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0099b0 tx=0x7f20dc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.234+0000 7f77ea7fc700 1 -- 172.21.15.26:0/2922454337 <== osd.6 v2:172.21.15.190:6823/90456 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f77d80725a0 con 0x7f77d806fae0 2023-09-28T00:15:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.243+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7fd68406fbe0 msgr2=0x7fd684071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.243+0000 7fd6a9be4700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7fd68406fbe0 0x7fd684071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.243+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 --> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8128064050 con 0x7f810c06fcb0 2023-09-28T00:15:35.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.244+0000 7f811d7fa700 1 -- 172.21.15.26:0/479270072 <== osd.2 v2:172.21.15.26:6800/90240 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8128064050 con 0x7f810c06fcb0 2023-09-28T00:15:35.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.244+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 --> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffb2c002d30 con 0x7ffb3806faf0 2023-09-28T00:15:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f810c06fcb0 msgr2=0x7f810c0720c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f810c06fcb0 0x7f810c0720c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f810c067480 msgr2=0x7f810c069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f810c067480 0x7f810c069930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81200097c0 tx=0x7f8120018000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 msgr2=0x7f81280cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 --2- 172.21.15.26:0/479270072 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f812815db60 0x7f81280cb0b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f811800c7f0 tx=0x7f8118007f70 comp rx=0 tx=0).stop 2023-09-28T00:15:35.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812d837700 1 -- 172.21.15.26:0/479270072 reap_dead start 2023-09-28T00:15:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 shutdown_connections 2023-09-28T00:15:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 >> 172.21.15.26:0/479270072 conn(0x7f8128068b90 msgr2=0x7f812806aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd684067330 msgr2=0x7fd6840697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7fd6a9be4700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd684067330 0x7fd6840697e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4179e50 tx=0x7fd69400b040 comp rx=0 tx=0).stop 2023-09-28T00:15:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a40ab3b0 msgr2=0x7fd6a41557a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7fd6a9be4700 1 --2- 172.21.15.26:0/3458390406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a40ab3b0 0x7fd6a41557a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd68c00b7e0 tx=0x7fd68c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 shutdown_connections 2023-09-28T00:15:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7fd6a3fff700 1 -- 172.21.15.26:0/3458390406 reap_dead start 2023-09-28T00:15:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f812f29a700 1 -- 172.21.15.26:0/479270072 wait complete. 2023-09-28T00:15:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 shutdown_connections 2023-09-28T00:15:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 >> 172.21.15.26:0/3458390406 conn(0x7fd6a4068b90 msgr2=0x7fd6a40694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 shutdown_connections 2023-09-28T00:15:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.246+0000 7fd6a9be4700 1 -- 172.21.15.26:0/3458390406 wait complete. 2023-09-28T00:15:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.246+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 --> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68e0002d30 con 0x7f68ec06fd30 2023-09-28T00:15:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.246+0000 7f68e7fff700 1 -- 172.21.15.26:0/894888832 <== osd.0 v2:172.21.15.26:6816/90241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f68e0002d30 con 0x7f68ec06fd30 2023-09-28T00:15:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f68ec06fd30 msgr2=0x7f68ec072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f68ec06fd30 0x7f68ec072140 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f68ec067480 msgr2=0x7f68ec069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f68ec067480 0x7f68ec069930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6900163570 tx=0x7f68f4006c60 comp rx=0 tx=0).stop 2023-09-28T00:15:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69000af750 msgr2=0x7f690015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 --2- 172.21.15.26:0/894888832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69000af750 0x7f690015baa0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009260 tx=0x7f68f0015000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f6904f19700 1 -- 172.21.15.26:0/894888832 reap_dead start 2023-09-28T00:15:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 shutdown_connections 2023-09-28T00:15:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 >> 172.21.15.26:0/894888832 conn(0x7f6900068b90 msgr2=0x7f690006ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 shutdown_connections 2023-09-28T00:15:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f690697c700 1 -- 172.21.15.26:0/894888832 wait complete. 2023-09-28T00:15:35.283 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.248+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 --> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a6c0b39d0 con 0x7f5a6c152ca0 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.245+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 --> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5758099ef0 con 0x7f573806fd30 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.246+0000 7f574f7fe700 1 -- 172.21.15.26:0/1548391119 <== osd.4 v2:172.21.15.190:6800/90454 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5758099ef0 con 0x7f573806fd30 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7f573806fd30 msgr2=0x7f5738072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f575d7b8700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7f573806fd30 0x7f5738072140 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5738067480 msgr2=0x7f5738069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f575d7b8700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5738067480 0x7f5738069930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5748009260 tx=0x7f5748016000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f575815df30 msgr2=0x7f57580aa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f575d7b8700 1 --2- 172.21.15.26:0/1548391119 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f575815df30 0x7f57580aa7f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f575000c830 tx=0x7f5750001690 comp rx=0 tx=0).stop 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f57577fe700 1 -- 172.21.15.26:0/1548391119 reap_dead start 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 shutdown_connections 2023-09-28T00:15:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.247+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 >> 172.21.15.26:0/1548391119 conn(0x7f5758068b90 msgr2=0x7f575806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.248+0000 7f5a53fff700 1 -- 172.21.15.26:0/1263651285 <== osd.1 v2:172.21.15.26:6808/90239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5a6c0b39d0 con 0x7f5a6c152ca0 2023-09-28T00:15:35.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.248+0000 7ffb33fff700 1 -- 172.21.15.26:0/3184255327 <== osd.3 v2:172.21.15.26:6824/90242 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffb2c002d30 con 0x7ffb3806faf0 2023-09-28T00:15:35.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.249+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7ffb3806faf0 msgr2=0x7ffb38071f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.249+0000 7ffb523c9700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7ffb3806faf0 0x7ffb38071f00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.249+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb380673b0 msgr2=0x7ffb38069860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.249+0000 7ffb523c9700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffb380673b0 0x7ffb38069860 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c006d40 tx=0x7ffb3c008040 comp rx=0 tx=0).stop 2023-09-28T00:15:35.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.249+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dad0 msgr2=0x7ffb4c0a8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.249+0000 7ffb523c9700 1 --2- 172.21.15.26:0/3184255327 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb4c15dad0 0x7ffb4c0a8b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c06cd30 tx=0x7ffb40017000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.249+0000 7ffb50966700 1 -- 172.21.15.26:0/3184255327 reap_dead start 2023-09-28T00:15:35.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.250+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 shutdown_connections 2023-09-28T00:15:35.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.250+0000 7f575d7b8700 1 -- 172.21.15.26:0/1548391119 wait complete. 2023-09-28T00:15:35.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7f5a6c152ca0 msgr2=0x7f5a6c1572a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7f5a72756700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7f5a6c152ca0 0x7f5a6c1572a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 shutdown_connections 2023-09-28T00:15:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 >> 172.21.15.26:0/3184255327 conn(0x7ffb4c0680b0 msgr2=0x7ffb4c069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5a58067400 msgr2=0x7f5a580698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7f5a72756700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5a58067400 0x7f5a580698b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a60009b30 tx=0x7f5a60008040 comp rx=0 tx=0).stop 2023-09-28T00:15:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a6c159500 msgr2=0x7f5a6c152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7f5a72756700 1 --2- 172.21.15.26:0/1263651285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a6c159500 0x7f5a6c152760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c013000 tx=0x7f5a5c017000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7f5a70cf3700 1 -- 172.21.15.26:0/1263651285 reap_dead start 2023-09-28T00:15:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 shutdown_connections 2023-09-28T00:15:35.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 >> 172.21.15.26:0/1263651285 conn(0x7f5a6c067630 msgr2=0x7f5a6c069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 shutdown_connections 2023-09-28T00:15:35.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.255+0000 7ffb523c9700 1 -- 172.21.15.26:0/3184255327 wait complete. 2023-09-28T00:15:35.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.256+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 shutdown_connections 2023-09-28T00:15:35.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.256+0000 7f5a72756700 1 -- 172.21.15.26:0/1263651285 wait complete. 2023-09-28T00:15:35.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.259+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 --> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20e80ae030 con 0x7f20d406fbe0 2023-09-28T00:15:35.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.260+0000 7f20ceffd700 1 -- 172.21.15.26:0/2008046813 <== osd.5 v2:172.21.15.190:6816/90467 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f20e80ae030 con 0x7f20d406fbe0 2023-09-28T00:15:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.260+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f20d406fbe0 msgr2=0x7f20d4071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.260+0000 7f20ed7b3700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f20d406fbe0 0x7f20d4071ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.262+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f20d4067330 msgr2=0x7f20d40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.262+0000 7f20ed7b3700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f20d4067330 0x7f20d40697e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0099b0 tx=0x7f20dc017000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.262+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e80cc090 msgr2=0x7f20e80b21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.262+0000 7f20ed7b3700 1 --2- 172.21.15.26:0/2008046813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f20e80cc090 0x7f20e80b21a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20d800c810 tx=0x7f20d8007df0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.262+0000 7f20e77fe700 1 -- 172.21.15.26:0/2008046813 reap_dead start 2023-09-28T00:15:35.292 INFO:teuthology.orchestra.run.smithi026.stdout:55834574857 2023-09-28T00:15:35.292 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-28T00:15:35.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.262+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 shutdown_connections 2023-09-28T00:15:35.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.262+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 >> 172.21.15.26:0/2008046813 conn(0x7f20e806e910 msgr2=0x7f20e80ac7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.293 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-09-28T00:15:35.294 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-09-28T00:15:35.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.270+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 --> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f77f40cbe00 con 0x7f77d806fae0 2023-09-28T00:15:35.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.271+0000 7f77ea7fc700 1 -- 172.21.15.26:0/2922454337 <== osd.6 v2:172.21.15.190:6823/90456 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f77f40cbe00 con 0x7f77d806fae0 2023-09-28T00:15:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.271+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f77d806fae0 msgr2=0x7f77d8071ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.271+0000 7f77fc3a8700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f77d806fae0 0x7f77d8071ef0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.271+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f77d8067330 msgr2=0x7f77d80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.271+0000 7f77fc3a8700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f77d8067330 0x7f77d80697e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77f40cb430 tx=0x7f77e4007b20 comp rx=0 tx=0).stop 2023-09-28T00:15:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.271+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77e00053c0 msgr2=0x7f77f4097f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.271+0000 7f77fc3a8700 1 --2- 172.21.15.26:0/2922454337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77e00053c0 0x7f77f4097f80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f77f000b590 tx=0x7f77f00090f0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.271+0000 7f77fa945700 1 -- 172.21.15.26:0/2922454337 reap_dead start 2023-09-28T00:15:35.296 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-09-28T00:15:35.296 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-28T00:15:35.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.273+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 shutdown_connections 2023-09-28T00:15:35.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.273+0000 7f20ed7b3700 1 -- 172.21.15.26:0/2008046813 wait complete. 2023-09-28T00:15:35.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.274+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 shutdown_connections 2023-09-28T00:15:35.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.274+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 >> 172.21.15.26:0/2922454337 conn(0x7f77f4068b90 msgr2=0x7f77f406d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.274+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 shutdown_connections 2023-09-28T00:15:35.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.274+0000 7f77fc3a8700 1 -- 172.21.15.26:0/2922454337 wait complete. 2023-09-28T00:15:35.298 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-09-28T00:15:35.298 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-09-28T00:15:35.299 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-09-28T00:15:35.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-28T00:15:35.300 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-09-28T00:15:35.300 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-28T00:15:35.301 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-09-28T00:15:35.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-09-28T00:15:35.302 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-09-28T00:15:35.302 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-09-28T00:15:35.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.527+0000 7f3f62401700 1 Processor -- start 2023-09-28T00:15:35.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.527+0000 7f3f62401700 1 -- start start 2023-09-28T00:15:35.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.528+0000 7f3f62401700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3f5c156930 0x7f3f5c0b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.528+0000 7f3f62401700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0adf70 con 0x7f3f5c0ab3b0 2023-09-28T00:15:35.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.528+0000 7f3f62401700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0ad360 con 0x7f3f5c0cb980 2023-09-28T00:15:35.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.528+0000 7f3f62401700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c0b0e00 con 0x7f3f5c156930 2023-09-28T00:15:35.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.531+0000 7f3f5bfff700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f3f5c0cb980 0x7f3f5c0ae400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:48634/0 (socket says 172.21.15.26:48634) 2023-09-28T00:15:35.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.531+0000 7f3f5bfff700 1 -- 172.21.15.26:0/2896720725 learned_addr learned my addr 172.21.15.26:0/2896720725 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546632743 0 0) 0x7f3f5c0ad360 con 0x7f3f5c0cb980 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f44003570 con 0x7f3f5c0cb980 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3829425127 0 0) 0x7f3f44003570 con 0x7f3f5c0cb980 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 >> v2:172.21.15.26:3300/0 conn(0x7f3f5c156930 msgr2=0x7f3f5c0b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 --2- 172.21.15.26:0/2896720725 >> v2:172.21.15.26:3300/0 conn(0x7f3f5c156930 0x7f3f5c0b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 >> v1:172.21.15.26:6789/0 conn(0x7f3f5c0ab3b0 legacy=0x7f3f5c156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0ad640 con 0x7f3f5c0cb980 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7f3f500014c0 con 0x7f3f5c0cb980 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 >> v1:172.21.15.190:6789/0 conn(0x7f3f5c0cb980 legacy=0x7f3f5c0ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 --2- 172.21.15.26:0/2896720725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f44003ae0 0x7f3f44003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 --2- 172.21.15.26:0/2896720725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 --2- 172.21.15.26:0/2896720725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f440053c0 0x7f3f44014290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0b0e00 con 0x7f3f44004810 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44014b70 con 0x7f3f440053c0 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.532+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44014d30 con 0x7f3f44003ae0 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.533+0000 7f3f5bfff700 1 --2- 172.21.15.26:0/2896720725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f44003ae0 0x7f3f44003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.533+0000 7f3f5bfff700 1 -- 172.21.15.26:0/2896720725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f440053c0 msgr2=0x7f3f44014290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.533+0000 7f3f5bfff700 1 --2- 172.21.15.26:0/2896720725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f440053c0 0x7f3f44014290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.533+0000 7f3f5bfff700 1 -- 172.21.15.26:0/2896720725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f44004810 msgr2=0x7f3f44004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.533+0000 7f3f5bfff700 1 --2- 172.21.15.26:0/2896720725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.533+0000 7f3f5bfff700 1 -- 172.21.15.26:0/2896720725 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0ad640 con 0x7f3f44003ae0 2023-09-28T00:15:35.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.533+0000 7f3f5bfff700 1 --2- 172.21.15.26:0/2896720725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f44003ae0 0x7f3f44003ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000c410 tx=0x7f3f50001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21cc0a5d2e493bd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.534+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000cce0 con 0x7f3f44003ae0 2023-09-28T00:15:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.534+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5000ce80 con 0x7f3f44003ae0 2023-09-28T00:15:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.534+0000 7f3f5affd700 1 -- 172.21.15.26:0/2896720725 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50005b70 con 0x7f3f44003ae0 2023-09-28T00:15:35.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.536+0000 7f3f6099e700 1 -- 172.21.15.26:0/2896720725 reap_dead start 2023-09-28T00:15:35.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.537+0000 7f3f62401700 1 -- 172.21.15.26:0/2896720725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f44003ae0 msgr2=0x7f3f44003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.537+0000 7f3f62401700 1 --2- 172.21.15.26:0/2896720725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f44003ae0 0x7f3f44003ed0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000c410 tx=0x7f3f50001e70 comp rx=0 tx=0).stop 2023-09-28T00:15:35.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.538+0000 7f3f62401700 1 -- 172.21.15.26:0/2896720725 shutdown_connections 2023-09-28T00:15:35.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.538+0000 7f3f62401700 1 --2- 172.21.15.26:0/2896720725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f44003ae0 0x7f3f44003ed0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.538+0000 7f3f62401700 1 -- 172.21.15.26:0/2896720725 >> 172.21.15.26:0/2896720725 conn(0x7f3f5c068b90 msgr2=0x7f3f5c0694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.538+0000 7fc9e5f6a700 1 Processor -- start 2023-09-28T00:15:35.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.539+0000 7fdfd8791700 1 Processor -- start 2023-09-28T00:15:35.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.539+0000 7fc9e5f6a700 1 -- start start 2023-09-28T00:15:35.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.539+0000 7fc9e5f6a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9e0155560 0x7fc9e00b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.539+0000 7fc9e5f6a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e00acd70 con 0x7fc9e00b2360 2023-09-28T00:15:35.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.540+0000 7fc9e5f6a700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e00ac160 con 0x7fc9e0068d50 2023-09-28T00:15:35.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.540+0000 7fc9e5f6a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e00ac440 con 0x7fc9e0155560 2023-09-28T00:15:35.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.540+0000 7fc9deffd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc9e00b2360 0x7fc9e0068640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43964/0 (socket says 172.21.15.26:43964) 2023-09-28T00:15:35.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.540+0000 7fc9deffd700 1 -- 172.21.15.26:0/4029928535 learned_addr learned my addr 172.21.15.26:0/4029928535 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:35.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.540+0000 7f847d5ba700 1 Processor -- start 2023-09-28T00:15:35.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.540+0000 7f847d5ba700 1 -- start start 2023-09-28T00:15:35.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7f847d5ba700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8478159500 0x7f84781598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7f847d5ba700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84780b3fd0 0x7f847815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7f847d5ba700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847815dd20 con 0x7f847815d8e0 2023-09-28T00:15:35.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7f847d5ba700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84780b1110 con 0x7f84780b3fd0 2023-09-28T00:15:35.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7f847d5ba700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84780b13b0 con 0x7f8478159500 2023-09-28T00:15:35.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.540+0000 7fdfd8791700 1 -- start start 2023-09-28T00:15:35.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7fdfd8791700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdfd00695e0 0x7fdfd015f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7fdfd8791700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd015ecd0 con 0x7fdfd015bc70 2023-09-28T00:15:35.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7fdfd8791700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd00b0300 con 0x7fdfd00cc480 2023-09-28T00:15:35.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7fdfd8791700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd00b0840 con 0x7fdfd00695e0 2023-09-28T00:15:35.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7f846e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84780b3fd0 0x7f847815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7f846e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f84780b3fd0 0x7f847815d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46552/0 (socket says 172.21.15.26:46552) 2023-09-28T00:15:35.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7f846e7fc700 1 -- 172.21.15.26:0/2835369241 learned_addr learned my addr 172.21.15.26:0/2835369241 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7f8476ffd700 1 --2- 172.21.15.26:0/2835369241 >> v2:172.21.15.190:3300/0 conn(0x7f8478159500 0x7f84781598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7fdfd5d2c700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fdfd00cc480 0x7fdfd0068ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:48662/0 (socket says 172.21.15.26:48662) 2023-09-28T00:15:35.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.541+0000 7fdfd5d2c700 1 -- 172.21.15.26:0/2717507057 learned_addr learned my addr 172.21.15.26:0/2717507057 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:35.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9df7fe700 1 --2- 172.21.15.26:0/4029928535 >> v2:172.21.15.26:3300/0 conn(0x7fc9e0155560 0x7fc9e00b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227778516 0 0) 0x7fc9e00ac160 con 0x7fc9e0068d50 2023-09-28T00:15:35.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd6d2e700 1 --2- 172.21.15.26:0/2717507057 >> v2:172.21.15.26:3300/0 conn(0x7fdfd00695e0 0x7fdfd015f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548573161 0 0) 0x7fdfd00b0300 con 0x7fdfd00cc480 2023-09-28T00:15:35.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfbc003570 con 0x7fdfd00cc480 2023-09-28T00:15:35.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c8003490 con 0x7fc9e0068d50 2023-09-28T00:15:35.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131563377 0 0) 0x7fc9e00acd70 con 0x7fc9e00b2360 2023-09-28T00:15:35.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7f3f62401700 1 -- 172.21.15.26:0/2896720725 shutdown_connections 2023-09-28T00:15:35.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7f8476ffd700 1 -- 172.21.15.26:0/2835369241 >> v2:172.21.15.26:3300/0 conn(0x7f84780b3fd0 msgr2=0x7f847815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7f8476ffd700 1 --2- 172.21.15.26:0/2835369241 >> v2:172.21.15.26:3300/0 conn(0x7f84780b3fd0 0x7f847815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7f3f62401700 1 -- 172.21.15.26:0/2896720725 wait complete. 2023-09-28T00:15:35.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7f8476ffd700 1 -- 172.21.15.26:0/2835369241 >> v1:172.21.15.190:6789/0 conn(0x7f847815d8e0 legacy=0x7f84780cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7f8476ffd700 1 -- 172.21.15.26:0/2835369241 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84780b1690 con 0x7f8478159500 2023-09-28T00:15:35.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9e00ac160 con 0x7fc9e00b2360 2023-09-28T00:15:35.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1606540082 0 0) 0x7fdfbc003570 con 0x7fdfd00cc480 2023-09-28T00:15:35.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 >> v2:172.21.15.26:3300/0 conn(0x7fdfd00695e0 msgr2=0x7fdfd015f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 --2- 172.21.15.26:0/2717507057 >> v2:172.21.15.26:3300/0 conn(0x7fdfd00695e0 0x7fdfd015f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 >> v1:172.21.15.26:6789/0 conn(0x7fdfd015bc70 legacy=0x7fdfd00afbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd00b0560 con 0x7fdfd00cc480 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fdfcc001470 con 0x7fdfd00cc480 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 >> v1:172.21.15.190:6789/0 conn(0x7fdfd00cc480 legacy=0x7fdfd0068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 --2- 172.21.15.26:0/2717507057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfbc003ae0 0x7fdfbc003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 --2- 172.21.15.26:0/2717507057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfbc004810 0x7fdfbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 --2- 172.21.15.26:0/2717507057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfbc0052e0 0x7fdfbc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00b0840 con 0x7fdfbc003ae0 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc00c280 con 0x7fdfbc004810 2023-09-28T00:15:35.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfbc00c440 con 0x7fdfbc0052e0 2023-09-28T00:15:35.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7f8476ffd700 1 --2- 172.21.15.26:0/2835369241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8478159500 0x7f84781598d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8478063e00 tx=0x7f8468009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc525e1135f545fc server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 330098533 0 0) 0x7fc9c8003490 con 0x7fc9e0068d50 2023-09-28T00:15:35.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 >> v2:172.21.15.26:3300/0 conn(0x7fc9e0155560 msgr2=0x7fc9e00b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 --2- 172.21.15.26:0/4029928535 >> v2:172.21.15.26:3300/0 conn(0x7fc9e0155560 0x7fc9e00b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 >> v1:172.21.15.26:6789/0 conn(0x7fc9e00b2360 legacy=0x7fc9e0068640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00ac720 con 0x7fc9e0068d50 2023-09-28T00:15:35.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fc9d8001720 con 0x7fc9e0068d50 2023-09-28T00:15:35.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 >> v1:172.21.15.190:6789/0 conn(0x7fc9e0068d50 legacy=0x7fc9e00ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9c80041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9c8004730 0x7fc9c8009140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9c8009680 0x7fc9c8009b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e00ac440 con 0x7fc9c8009680 2023-09-28T00:15:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c800a2c0 con 0x7fc9c8004730 2023-09-28T00:15:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c800a480 con 0x7fc9c8003e00 2023-09-28T00:15:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9deffd700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9c8004730 0x7fc9c8009140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.542+0000 7f84767fc700 1 -- 172.21.15.26:0/2835369241 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800e070 con 0x7f8478159500 2023-09-28T00:15:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7f84767fc700 1 -- 172.21.15.26:0/2835369241 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800bb20 con 0x7f8478159500 2023-09-28T00:15:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7f84767fc700 1 -- 172.21.15.26:0/2835369241 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468012430 con 0x7f8478159500 2023-09-28T00:15:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9df7fe700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9c80041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9df7fe700 1 -- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9c8004730 msgr2=0x7fc9c8009140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9df7fe700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9c8004730 0x7fc9c8009140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9df7fe700 1 -- 172.21.15.26:0/4029928535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9c8009680 msgr2=0x7fc9c8009b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9df7fe700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9c8009680 0x7fc9c8009b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9df7fe700 1 -- 172.21.15.26:0/4029928535 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e00ac720 con 0x7fc9c8003e00 2023-09-28T00:15:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9dffff700 1 -- 172.21.15.26:0/4029928535 reap_dead start 2023-09-28T00:15:35.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7f744161e700 1 Processor -- start 2023-09-28T00:15:35.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9df7fe700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9c80041f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400bb90 tx=0x7fc9d4008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff6979dece01d4c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d400d5d0 con 0x7fc9c8003e00 2023-09-28T00:15:35.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fc9de7fc700 1 -- 172.21.15.26:0/4029928535 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d400d750 con 0x7fc9c8003e00 2023-09-28T00:15:35.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f3f62401700 1 Processor -- start 2023-09-28T00:15:35.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f847d5ba700 1 -- 172.21.15.26:0/2835369241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8478159500 msgr2=0x7f84781598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f847d5ba700 1 --2- 172.21.15.26:0/2835369241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8478159500 0x7f84781598d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8478063e00 tx=0x7f8468009780 comp rx=0 tx=0).stop 2023-09-28T00:15:35.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7fdfd5d2c700 1 --2- 172.21.15.26:0/2717507057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfbc004810 0x7fdfbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f847d5ba700 1 -- 172.21.15.26:0/2835369241 shutdown_connections 2023-09-28T00:15:35.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f847d5ba700 1 --2- 172.21.15.26:0/2835369241 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8478159500 0x7f84781598d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f847d5ba700 1 --2- 172.21.15.26:0/2835369241 >> v2:172.21.15.26:3300/0 conn(0x7f84780b3fd0 0x7f847815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f847d5ba700 1 -- 172.21.15.26:0/2835369241 >> 172.21.15.26:0/2835369241 conn(0x7f8478067630 msgr2=0x7f8478069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f3f62401700 1 -- start start 2023-09-28T00:15:35.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f847d5ba700 1 -- 172.21.15.26:0/2835369241 shutdown_connections 2023-09-28T00:15:35.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f847d5ba700 1 -- 172.21.15.26:0/2835369241 wait complete. 2023-09-28T00:15:35.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.543+0000 7f744161e700 1 -- start start 2023-09-28T00:15:35.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f744161e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f743c15dc60 0x7f743c0b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f744161e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 0x7f743c0694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f744161e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f743c0cc900 con 0x7f743c15d890 2023-09-28T00:15:35.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f744161e700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f743c0cd260 con 0x7f743c15dc60 2023-09-28T00:15:35.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f744161e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c0d0520 con 0x7f743c0b4b90 2023-09-28T00:15:35.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 msgr2=0x7fc9c80041f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7fc9e5f6a700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9c80041f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400bb90 tx=0x7fc9d4008040 comp rx=0 tx=0).stop 2023-09-28T00:15:35.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/4029928535 shutdown_connections 2023-09-28T00:15:35.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fc9e5f6a700 1 --2- 172.21.15.26:0/4029928535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9c80041f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/4029928535 >> 172.21.15.26:0/4029928535 conn(0x7fc9e006be70 msgr2=0x7fc9e00cc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f743a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f743c15dc60 0x7f743c0b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f743b7fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 0x7f743c0694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.544+0000 7f743a7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f743c15dc60 0x7f743c0b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46584/0 (socket says 172.21.15.26:46584) 2023-09-28T00:15:35.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f743a7fc700 1 -- 172.21.15.26:0/2039453798 learned_addr learned my addr 172.21.15.26:0/2039453798 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f743b7fe700 1 --2- 172.21.15.26:0/2039453798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 0x7f743c0694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34602/0 (socket says 172.21.15.26:34602) 2023-09-28T00:15:35.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fdfd5d2c700 1 -- 172.21.15.26:0/2717507057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfbc0052e0 msgr2=0x7fdfbc00ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:15:35.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fdfd5d2c700 1 --2- 172.21.15.26:0/2717507057 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfbc0052e0 0x7fdfbc00ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fdfd5d2c700 1 -- 172.21.15.26:0/2717507057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfbc003ae0 msgr2=0x7fdfbc003ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-28T00:15:35.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fdfd5d2c700 1 --2- 172.21.15.26:0/2717507057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfbc003ae0 0x7fdfbc003ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fdfd5d2c700 1 -- 172.21.15.26:0/2717507057 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd00b0560 con 0x7fdfbc004810 2023-09-28T00:15:35.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/4029928535 shutdown_connections 2023-09-28T00:15:35.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fdfd6d2e700 1 -- 172.21.15.26:0/2717507057 reap_dead start 2023-09-28T00:15:35.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f62401700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f44003ae0 0x7f3f5c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f62401700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f5c14ebd0 0x7f3f5c14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f62401700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f5c153750 0x7f3f5c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f62401700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c154100 con 0x7f3f44003ae0 2023-09-28T00:15:35.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f62401700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c14ffc0 con 0x7f3f5c153750 2023-09-28T00:15:35.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f62401700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c14f3b0 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f743a7fc700 1 -- 172.21.15.26:0/2039453798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 msgr2=0x7f743c0694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f743a7fc700 1 --2- 172.21.15.26:0/2039453798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 0x7f743c0694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f743a7fc700 1 -- 172.21.15.26:0/2039453798 >> v1:172.21.15.190:6789/0 conn(0x7f743c15d890 legacy=0x7f743c0cfd10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T00:15:35.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f743a7fc700 1 -- 172.21.15.26:0/2039453798 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0ccba0 con 0x7f743c15dc60 2023-09-28T00:15:35.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f6099e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f5c153750 0x7f3f5c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fd6af1ec700 1 Processor -- start 2023-09-28T00:15:35.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f743a7fc700 1 --2- 172.21.15.26:0/2039453798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15dc60 0x7f743c0b41f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f742c0099b0 tx=0x7f742c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf73c25ef429823 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fd6af1ec700 1 -- start start 2023-09-28T00:15:35.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f44003ae0 0x7f3f5c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f5b7fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f5c14ebd0 0x7f3f5c14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f44003ae0 0x7f3f5c152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46598/0 (socket says 172.21.15.26:46598) 2023-09-28T00:15:35.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7f3f5bfff700 1 -- 172.21.15.26:0/930758039 learned_addr learned my addr 172.21.15.26:0/930758039 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f7439ffb700 1 -- 172.21.15.26:0/2039453798 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c009ea0 con 0x7f743c15dc60 2023-09-28T00:15:35.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f7439ffb700 1 -- 172.21.15.26:0/2039453798 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742c00b820 con 0x7f743c15dc60 2023-09-28T00:15:35.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f7439ffb700 1 -- 172.21.15.26:0/2039453798 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00bbc0 con 0x7f743c15dc60 2023-09-28T00:15:35.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f847d5ba700 1 Processor -- start 2023-09-28T00:15:35.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f5b7fe700 1 -- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f5c153750 msgr2=0x7f3f5c153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f5b7fe700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f5c153750 0x7f3f5c153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f5b7fe700 1 -- 172.21.15.26:0/930758039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f44003ae0 msgr2=0x7f3f5c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f5b7fe700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f44003ae0 0x7f3f5c152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f5b7fe700 1 -- 172.21.15.26:0/930758039 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c14f690 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f6099e700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f5c153750 0x7f3f5c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:35.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f847d5ba700 1 -- start start 2023-09-28T00:15:35.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f5b7fe700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f5c14ebd0 0x7f3f5c14d9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00b4c0 tx=0x7f3f4c009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7fdfd5d2c700 1 --2- 172.21.15.26:0/2717507057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfbc004810 0x7fdfbc004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00c3e0 tx=0x7fdfcc007940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0395d9ceb7f7a66 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f43fff700 1 -- 172.21.15.26:0/930758039 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00f510 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f43fff700 1 -- 172.21.15.26:0/930758039 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c00f690 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.546+0000 7f3f43fff700 1 -- 172.21.15.26:0/930758039 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00fa50 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c14f970 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c14f040 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.545+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/4029928535 wait complete. 2023-09-28T00:15:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fc9e5f6a700 1 Processor -- start 2023-09-28T00:15:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f744161e700 1 -- 172.21.15.26:0/2039453798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15dc60 msgr2=0x7f743c0b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f744161e700 1 --2- 172.21.15.26:0/2039453798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15dc60 0x7f743c0b41f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f742c0099b0 tx=0x7f742c009250 comp rx=0 tx=0).stop 2023-09-28T00:15:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fd6af1ec700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fd6af1ec700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a80b0f40 con 0x7fd6a80a6de0 2023-09-28T00:15:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fd6af1ec700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a815aeb0 con 0x7fd6a806ed20 2023-09-28T00:15:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fd6af1ec700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a815a8f0 con 0x7fd6a81597d0 2023-09-28T00:15:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fd6acf88700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fd6acf88700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34612/0 (socket says 172.21.15.26:34612) 2023-09-28T00:15:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fd6acf88700 1 -- 172.21.15.26:0/778359614 learned_addr learned my addr 172.21.15.26:0/778359614 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fd6a7fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd6a80a6de0 0x7fd6a806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43984/0 (socket says 172.21.15.26:43984) 2023-09-28T00:15:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f744161e700 1 -- 172.21.15.26:0/2039453798 shutdown_connections 2023-09-28T00:15:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f744161e700 1 --2- 172.21.15.26:0/2039453798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 0x7f743c0694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f744161e700 1 --2- 172.21.15.26:0/2039453798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15dc60 0x7f743c0b41f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f744161e700 1 -- 172.21.15.26:0/2039453798 >> 172.21.15.26:0/2039453798 conn(0x7f743c0680b0 msgr2=0x7f743c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f847d5ba700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84780b3fd0 0x7f847816d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f847d5ba700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8478159500 0x7f84780b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f847d5ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f847815d8e0 0x7f847816b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f847d5ba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847814c080 con 0x7f847815d8e0 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f847d5ba700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84780b5ff0 con 0x7f84780b3fd0 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f847d5ba700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847814aa20 con 0x7f8478159500 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f846e7fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8478159500 0x7f84780b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f8476ffd700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84780b3fd0 0x7f847816d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f846e7fc700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8478159500 0x7f84780b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34622/0 (socket says 172.21.15.26:34622) 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f846e7fc700 1 -- 172.21.15.26:0/1237022044 learned_addr learned my addr 172.21.15.26:0/1237022044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7f84777fe700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f847815d8e0 0x7f847816b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7f744161e700 1 -- 172.21.15.26:0/2039453798 shutdown_connections 2023-09-28T00:15:35.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fd6a77fe700 1 -- 172.21.15.26:0/778359614 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460294974 0 0) 0x7fd6a80b0f40 con 0x7fd6a80a6de0 2023-09-28T00:15:35.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fd6a77fe700 1 -- 172.21.15.26:0/778359614 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd698003570 con 0x7fd6a80a6de0 2023-09-28T00:15:35.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fd6acf88700 1 -- 172.21.15.26:0/778359614 >> v1:172.21.15.190:6789/0 conn(0x7fd6a806ed20 legacy=0x7fd6a815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fd6acf88700 1 -- 172.21.15.26:0/778359614 >> v1:172.21.15.26:6789/0 conn(0x7fd6a80a6de0 legacy=0x7fd6a806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.570 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fd6acf88700 1 -- 172.21.15.26:0/778359614 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a815abd0 con 0x7fd6a81597d0 2023-09-28T00:15:35.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7f744161e700 1 -- 172.21.15.26:0/2039453798 wait complete. 2023-09-28T00:15:35.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fc9e5f6a700 1 -- start start 2023-09-28T00:15:35.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9e5f6a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9e0159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9e5f6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00aaf10 0x7fc9e0176570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.571 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9e5f6a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e00a8640 0x7fc9e00a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9e5f6a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e015a630 con 0x7fc9e00aaf10 2023-09-28T00:15:35.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9e5f6a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e0159d90 con 0x7fc9e00a8640 2023-09-28T00:15:35.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9e5f6a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e015a070 con 0x7fc9c8003e00 2023-09-28T00:15:35.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7f846e7fc700 1 -- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84780b3fd0 msgr2=0x7f847816d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7f846e7fc700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84780b3fd0 0x7f847816d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7f846e7fc700 1 -- 172.21.15.26:0/1237022044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f847815d8e0 msgr2=0x7f847816b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9deffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00aaf10 0x7fc9e0176570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7f846e7fc700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f847815d8e0 0x7f847816b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7f846e7fc700 1 -- 172.21.15.26:0/1237022044 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009a20 con 0x7f8478159500 2023-09-28T00:15:35.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fd6acf88700 1 --2- 172.21.15.26:0/778359614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80b1970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6940099e0 tx=0x7fd694009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea0fe318c9d0f0ce server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.573 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c150170 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7ff22a356700 1 Processor -- start 2023-09-28T00:15:35.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7ff22a356700 1 -- start start 2023-09-28T00:15:35.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fd6a77fe700 1 -- 172.21.15.26:0/778359614 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400b820 con 0x7fd6a81597d0 2023-09-28T00:15:35.574 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc007b90 con 0x7fdfbc004810 2023-09-28T00:15:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00ccb0 con 0x7fdfbc004810 2023-09-28T00:15:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.547+0000 7fdfd552b700 1 -- 172.21.15.26:0/2717507057 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc005b50 con 0x7fdfbc004810 2023-09-28T00:15:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fd6a77fe700 1 -- 172.21.15.26:0/778359614 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69400b980 con 0x7fd6a81597d0 2023-09-28T00:15:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fd6a77fe700 1 -- 172.21.15.26:0/778359614 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400bd20 con 0x7fd6a81597d0 2023-09-28T00:15:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fdfd8791700 1 -- 172.21.15.26:0/2717507057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfbc004810 msgr2=0x7fdfbc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fdfd8791700 1 --2- 172.21.15.26:0/2717507057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfbc004810 0x7fdfbc004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00c3e0 tx=0x7fdfcc007940 comp rx=0 tx=0).stop 2023-09-28T00:15:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fdfd8791700 1 -- 172.21.15.26:0/2717507057 shutdown_connections 2023-09-28T00:15:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fdfd8791700 1 --2- 172.21.15.26:0/2717507057 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfbc004810 0x7fdfbc004c80 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00c3e0 tx=0x7fdfcc007940 comp rx=0 tx=0).stop 2023-09-28T00:15:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9deffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00aaf10 0x7fc9e0176570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46622/0 (socket says 172.21.15.26:46622) 2023-09-28T00:15:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9deffd700 1 -- 172.21.15.26:0/3817266880 learned_addr learned my addr 172.21.15.26:0/3817266880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9dffff700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e00a8640 0x7fc9e00a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fdfd8791700 1 -- 172.21.15.26:0/2717507057 >> 172.21.15.26:0/2717507057 conn(0x7fdfd006e910 msgr2=0x7fdfd006be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9deffd700 1 -- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 msgr2=0x7fc9e0159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.548+0000 7fc9df7fe700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9e0159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9deffd700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9e0159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9deffd700 1 -- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e00a8640 msgr2=0x7fc9e00a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9deffd700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e00a8640 0x7fc9e00a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9deffd700 1 -- 172.21.15.26:0/3817266880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e015a350 con 0x7fc9e00aaf10 2023-09-28T00:15:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9dffff700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e00a8640 0x7fc9e00a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9df7fe700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9e0159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9deffd700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00aaf10 0x7fc9e0176570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0001860 tx=0x7fc9d0007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9c77fe700 1 -- 172.21.15.26:0/3817266880 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0004900 con 0x7fc9e00aaf10 2023-09-28T00:15:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9c77fe700 1 -- 172.21.15.26:0/3817266880 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d0011590 con 0x7fc9e00aaf10 2023-09-28T00:15:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9c77fe700 1 -- 172.21.15.26:0/3817266880 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0011950 con 0x7fc9e00aaf10 2023-09-28T00:15:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e00a5e10 con 0x7fc9e00aaf10 2023-09-28T00:15:35.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e00a8ff0 con 0x7fc9e00aaf10 2023-09-28T00:15:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fd6af1ec700 1 -- 172.21.15.26:0/778359614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 msgr2=0x7fd6a80b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fd6af1ec700 1 --2- 172.21.15.26:0/778359614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80b1970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6940099e0 tx=0x7fd694009250 comp rx=0 tx=0).stop 2023-09-28T00:15:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7f3f43fff700 1 -- 172.21.15.26:0/930758039 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f3f4c024430 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff22a356700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff224159500 0x7ff2241598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff22a356700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2240b3fd0 0x7ff22415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff22a356700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff22415dd20 con 0x7ff22415d8e0 2023-09-28T00:15:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff22a356700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2240b1110 con 0x7ff2240b3fd0 2023-09-28T00:15:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff22a356700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2240b13b0 con 0x7ff224159500 2023-09-28T00:15:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7f846e7fc700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8478159500 0x7f84780b5ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f846000ea50 tx=0x7f8460009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff2237fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2240b3fd0 0x7ff22415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff2237fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff2240b3fd0 0x7ff22415d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46632/0 (socket says 172.21.15.26:46632) 2023-09-28T00:15:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff2237fe700 1 -- 172.21.15.26:0/2808434407 learned_addr learned my addr 172.21.15.26:0/2808434407 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff2288f3700 1 --1- 172.21.15.26:0/2808434407 >> v1:172.21.15.26:6789/0 conn(0x7ff22415d8e0 0x7ff2240cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43998/0 (socket says 172.21.15.26:43998) 2023-09-28T00:15:35.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7f744161e700 1 Processor -- start 2023-09-28T00:15:35.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff2237fe700 1 -- 172.21.15.26:0/2808434407 >> v2:172.21.15.190:3300/0 conn(0x7ff224159500 msgr2=0x7ff2241598d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-28T00:15:35.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff2237fe700 1 --2- 172.21.15.26:0/2808434407 >> v2:172.21.15.190:3300/0 conn(0x7ff224159500 0x7ff2241598d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff2237fe700 1 -- 172.21.15.26:0/2808434407 >> v1:172.21.15.26:6789/0 conn(0x7ff22415d8e0 legacy=0x7ff2240cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff222ffd700 1 -- 172.21.15.26:0/2808434407 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611378512 0 0) 0x7ff22415dd20 con 0x7ff22415d8e0 2023-09-28T00:15:35.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff2237fe700 1 -- 172.21.15.26:0/2808434407 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2240b1690 con 0x7ff2240b3fd0 2023-09-28T00:15:35.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7f744161e700 1 -- start start 2023-09-28T00:15:35.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7ff2237fe700 1 --2- 172.21.15.26:0/2808434407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 0x7ff22415d3a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff224063e00 tx=0x7ff214009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd2fa008aed5485 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7ff222ffd700 1 -- 172.21.15.26:0/2808434407 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400b860 con 0x7ff2240b3fd0 2023-09-28T00:15:35.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7ff222ffd700 1 -- 172.21.15.26:0/2808434407 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21400b9c0 con 0x7ff2240b3fd0 2023-09-28T00:15:35.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7ff222ffd700 1 -- 172.21.15.26:0/2808434407 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400bd60 con 0x7ff2240b3fd0 2023-09-28T00:15:35.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e0064050 con 0x7fc9e00aaf10 2023-09-28T00:15:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7f744161e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 0x7f743c142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7f744161e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15d890 0x7f743c148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7f744161e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f743c15dc60 0x7f743c149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7f744161e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c14a550 con 0x7f743c15d890 2023-09-28T00:15:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7f744161e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743c149940 con 0x7f743c15dc60 2023-09-28T00:15:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7f744161e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743c149c20 con 0x7f743c0b4b90 2023-09-28T00:15:35.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7f3f43fff700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f3f48067400 0x7f3f480698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.550+0000 7f3f43fff700 1 -- 172.21.15.26:0/930758039 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f4c084e80 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7f3f5bfff700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f3f48067400 0x7f3f480698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7f3f5bfff700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f3f48067400 0x7f3f480698b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f50006fd0 tx=0x7f3f50015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.551+0000 7f743a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15d890 0x7f743c148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15d890 0x7f743c148e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46636/0 (socket says 172.21.15.26:46636) 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743a7fc700 1 -- 172.21.15.26:0/1826299463 learned_addr learned my addr 172.21.15.26:0/1826299463 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743b7fe700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f743c15dc60 0x7f743c149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743affd700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 0x7f743c142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743b7fe700 1 -- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 msgr2=0x7f743c142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743b7fe700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 0x7f743c142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743b7fe700 1 -- 172.21.15.26:0/1826299463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15d890 msgr2=0x7f743c148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743b7fe700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15d890 0x7f743c148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743b7fe700 1 -- 172.21.15.26:0/1826299463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c0094f0 con 0x7f743c15dc60 2023-09-28T00:15:35.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743a7fc700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15d890 0x7f743c148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f743b7fe700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f743c15dc60 0x7f743c149350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7434009e50 tx=0x7f743400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7fc9c77fe700 1 -- 172.21.15.26:0/3817266880 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc9d0011d40 con 0x7fc9e00aaf10 2023-09-28T00:15:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f7422ffd700 1 -- 172.21.15.26:0/1826299463 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743400caa0 con 0x7f743c15dc60 2023-09-28T00:15:35.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f7422ffd700 1 -- 172.21.15.26:0/1826299463 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743400f040 con 0x7f743c15dc60 2023-09-28T00:15:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f7422ffd700 1 -- 172.21.15.26:0/1826299463 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743400ce50 con 0x7f743c15dc60 2023-09-28T00:15:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743c149f00 con 0x7f743c15dc60 2023-09-28T00:15:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743c1474e0 con 0x7f743c15dc60 2023-09-28T00:15:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7ff22a356700 1 -- 172.21.15.26:0/2808434407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 msgr2=0x7ff22415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.552+0000 7ff22a356700 1 --2- 172.21.15.26:0/2808434407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 0x7ff22415d3a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff224063e00 tx=0x7ff214009250 comp rx=0 tx=0).stop 2023-09-28T00:15:35.588 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.553+0000 7fc9c77fe700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc9cc067360 0x7fc9cc069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.553+0000 7fc9c77fe700 1 -- 172.21.15.26:0/3817266880 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc9d0084bb0 con 0x7fc9e00aaf10 2023-09-28T00:15:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.553+0000 7fc9df7fe700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc9cc067360 0x7fc9cc069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.553+0000 7ff22a356700 1 -- 172.21.15.26:0/2808434407 shutdown_connections 2023-09-28T00:15:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.553+0000 7ff22a356700 1 --2- 172.21.15.26:0/2808434407 >> v2:172.21.15.190:3300/0 conn(0x7ff224159500 0x7ff2241598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.553+0000 7ff22a356700 1 --2- 172.21.15.26:0/2808434407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 0x7ff22415d3a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.553+0000 7ff22a356700 1 -- 172.21.15.26:0/2808434407 >> 172.21.15.26:0/2808434407 conn(0x7ff224067630 msgr2=0x7ff224069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.553+0000 7fc9df7fe700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc9cc067360 0x7fc9cc069810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400bfd0 tx=0x7fc9d401b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.553+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743c064050 con 0x7f743c15dc60 2023-09-28T00:15:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.549+0000 7fdfd8791700 1 -- 172.21.15.26:0/2717507057 shutdown_connections 2023-09-28T00:15:35.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7fdfd8791700 1 -- 172.21.15.26:0/2717507057 wait complete. 2023-09-28T00:15:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7fd6af1ec700 1 -- 172.21.15.26:0/778359614 shutdown_connections 2023-09-28T00:15:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7fd6af1ec700 1 --2- 172.21.15.26:0/778359614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80b1970 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7fd6af1ec700 1 -- 172.21.15.26:0/778359614 >> 172.21.15.26:0/778359614 conn(0x7fd6a80680b0 msgr2=0x7fd6a80684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7fd6af1ec700 1 -- 172.21.15.26:0/778359614 shutdown_connections 2023-09-28T00:15:35.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7fd6af1ec700 1 -- 172.21.15.26:0/778359614 wait complete. 2023-09-28T00:15:35.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7ff22a356700 1 -- 172.21.15.26:0/2808434407 shutdown_connections 2023-09-28T00:15:35.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7f846f7fe700 1 -- 172.21.15.26:0/1237022044 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000c640 con 0x7f8478159500 2023-09-28T00:15:35.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7f846f7fe700 1 -- 172.21.15.26:0/1237022044 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000c7a0 con 0x7f8478159500 2023-09-28T00:15:35.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.554+0000 7f846f7fe700 1 -- 172.21.15.26:0/1237022044 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000cb20 con 0x7f8478159500 2023-09-28T00:15:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.555+0000 7f7422ffd700 1 -- 172.21.15.26:0/1826299463 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f7434014690 con 0x7f743c15dc60 2023-09-28T00:15:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.555+0000 7f3f43fff700 1 -- 172.21.15.26:0/930758039 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f3f4c051ee0 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.555+0000 7fd6af1ec700 1 Processor -- start 2023-09-28T00:15:35.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.555+0000 7fdfd8791700 1 Processor -- start 2023-09-28T00:15:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.555+0000 7f7422ffd700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7428067360 0x7f7428069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.555+0000 7f7422ffd700 1 -- 172.21.15.26:0/1826299463 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7434085c90 con 0x7f743c15dc60 2023-09-28T00:15:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.555+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847816a5b0 con 0x7f8478159500 2023-09-28T00:15:35.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.555+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847816ab70 con 0x7f8478159500 2023-09-28T00:15:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7f743affd700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7428067360 0x7f7428069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7f743affd700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7428067360 0x7f7428069810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7430006fd0 tx=0x7f74300090f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fdfd8791700 1 -- start start 2023-09-28T00:15:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fdfd8791700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfd00aaba0 0x7fdfd00aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fdfd8791700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfd015ab00 0x7fdfd014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fdfd8791700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfd01483f0 0x7fdfd0149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fdfd8791700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01498e0 con 0x7fdfd01483f0 2023-09-28T00:15:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fdfd8791700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0148cd0 con 0x7fdfd00aaba0 2023-09-28T00:15:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fdfd8791700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd0148fb0 con 0x7fdfd015ab00 2023-09-28T00:15:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd652d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfd00aaba0 0x7fdfd00aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd652d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfd00aaba0 0x7fdfd00aaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:38314/0 (socket says 172.21.15.26:38314) 2023-09-28T00:15:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd652d700 1 -- 172.21.15.26:0/3995502599 learned_addr learned my addr 172.21.15.26:0/3995502599 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847814abb0 con 0x7f8478159500 2023-09-28T00:15:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fd6af1ec700 1 -- start start 2023-09-28T00:15:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fd6af1ec700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a806ed20 0x7fd6a8154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.556+0000 7fd6af1ec700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a80a6de0 0x7fd6a8154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6af1ec700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6af1ec700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a8154270 con 0x7fd6a80a6de0 2023-09-28T00:15:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6af1ec700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80cb490 con 0x7fd6a806ed20 2023-09-28T00:15:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6af1ec700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a80a4000 con 0x7fd6a81597d0 2023-09-28T00:15:35.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a80a6de0 0x7fd6a8154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6a7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a80a6de0 0x7fd6a8154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46644/0 (socket says 172.21.15.26:46644) 2023-09-28T00:15:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6a7fff700 1 -- 172.21.15.26:0/878022427 learned_addr learned my addr 172.21.15.26:0/878022427 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd6d2e700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfd01483f0 0x7fdfd0149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd652d700 1 -- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfd015ab00 msgr2=0x7fdfd014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd652d700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfd015ab00 0x7fdfd014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd652d700 1 -- 172.21.15.26:0/3995502599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfd01483f0 msgr2=0x7fdfd0149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd652d700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfd01483f0 0x7fdfd0149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd652d700 1 -- 172.21.15.26:0/3995502599 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0149290 con 0x7fdfd00aaba0 2023-09-28T00:15:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fdfd6d2e700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfd01483f0 0x7fdfd0149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6ad789700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6acf88700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a806ed20 0x7fd6a8154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7ff22a356700 1 -- 172.21.15.26:0/2808434407 wait complete. 2023-09-28T00:15:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6a7fff700 1 -- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 msgr2=0x7fd6a80ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6a7fff700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6a7fff700 1 -- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a806ed20 msgr2=0x7fd6a8154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6a7fff700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a806ed20 0x7fd6a8154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6a7fff700 1 -- 172.21.15.26:0/878022427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6940094f0 con 0x7fd6a80a6de0 2023-09-28T00:15:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.557+0000 7fd6acf88700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a806ed20 0x7fd6a8154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:35.600 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.558+0000 7f846f7fe700 1 -- 172.21.15.26:0/1237022044 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f8460013470 con 0x7f8478159500 2023-09-28T00:15:35.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.558+0000 7fd6a7fff700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a80a6de0 0x7fd6a8154950 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00c7f0 tx=0x7fd69c007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.558+0000 7f846f7fe700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8458067330 0x7f84580697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.558+0000 7f846f7fe700 1 -- 172.21.15.26:0/1237022044 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8460084ce0 con 0x7f8478159500 2023-09-28T00:15:35.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.558+0000 7f8476ffd700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8458067330 0x7f84580697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.559+0000 7ff22a356700 1 Processor -- start 2023-09-28T00:15:35.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.559+0000 7f8476ffd700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8458067330 0x7f84580697e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8468009fd0 tx=0x7f8468018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.602 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.559+0000 7ff22a356700 1 -- start start 2023-09-28T00:15:35.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.559+0000 7f7422ffd700 1 -- 172.21.15.26:0/1826299463 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f74340566a0 con 0x7f743c15dc60 2023-09-28T00:15:35.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff22a356700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 0x7ff22414b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff22a356700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff22415d8e0 0x7ff2241762b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.603 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff22a356700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff224069930 0x7ff2240689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff22a356700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff224179ea0 con 0x7ff2240b3fd0 2023-09-28T00:15:35.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff22a356700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff22417a9e0 con 0x7ff224069930 2023-09-28T00:15:35.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff22a356700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22417a0b0 con 0x7ff22415d8e0 2023-09-28T00:15:35.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7fc9c77fe700 1 -- 172.21.15.26:0/3817266880 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc9d0051ab0 con 0x7fc9e00aaf10 2023-09-28T00:15:35.604 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff223fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 0x7ff22414b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff223fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 0x7ff22414b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46662/0 (socket says 172.21.15.26:46662) 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff223fff700 1 -- 172.21.15.26:0/3121671218 learned_addr learned my addr 172.21.15.26:0/3121671218 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff2237fe700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff22415d8e0 0x7ff2241762b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff2288f3700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff224069930 0x7ff2240689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff2237fe700 1 -- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff224069930 msgr2=0x7ff2240689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff2237fe700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff224069930 0x7ff2240689d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff2237fe700 1 -- 172.21.15.26:0/3121671218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 msgr2=0x7ff22414b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff2237fe700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 0x7ff22414b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff2237fe700 1 -- 172.21.15.26:0/3121671218 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2140094f0 con 0x7ff22415d8e0 2023-09-28T00:15:35.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7ff223fff700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 0x7ff22414b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.561+0000 7ff2237fe700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff22415d8e0 0x7ff2241762b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff22406a270 tx=0x7ff214017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7fd6a4ff9700 1 -- 172.21.15.26:0/878022427 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c005b40 con 0x7fd6a80a6de0 2023-09-28T00:15:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7fd6a4ff9700 1 -- 172.21.15.26:0/878022427 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c005cc0 con 0x7fd6a80a6de0 2023-09-28T00:15:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a80cb1b0 con 0x7fd6a80a6de0 2023-09-28T00:15:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7fd6a4ff9700 1 -- 172.21.15.26:0/878022427 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c007320 con 0x7fd6a80a6de0 2023-09-28T00:15:35.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.560+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a80a3c90 con 0x7fd6a80a6de0 2023-09-28T00:15:35.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.563+0000 7f846f7fe700 1 -- 172.21.15.26:0/1237022044 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f8460051be0 con 0x7f8478159500 2023-09-28T00:15:35.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.563+0000 7fd6a4ff9700 1 -- 172.21.15.26:0/878022427 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd69c01b3b0 con 0x7fd6a80a6de0 2023-09-28T00:15:35.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.564+0000 7fd6a4ff9700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd68c067380 0x7fd68c069830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.564+0000 7fd6a4ff9700 1 -- 172.21.15.26:0/878022427 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd69c084130 con 0x7fd6a80a6de0 2023-09-28T00:15:35.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.563+0000 7ff20bfff700 1 -- 172.21.15.26:0/3121671218 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214011e20 con 0x7ff22415d8e0 2023-09-28T00:15:35.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.563+0000 7ff20bfff700 1 -- 172.21.15.26:0/3121671218 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21401a630 con 0x7ff22415d8e0 2023-09-28T00:15:35.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.563+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff22417a390 con 0x7ff22415d8e0 2023-09-28T00:15:35.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.563+0000 7ff20bfff700 1 -- 172.21.15.26:0/3121671218 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21401a9f0 con 0x7ff22415d8e0 2023-09-28T00:15:35.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.563+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff224069db0 con 0x7ff22415d8e0 2023-09-28T00:15:35.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.564+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22417a1f0 con 0x7ff22415d8e0 2023-09-28T00:15:35.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.564+0000 7ff20bfff700 1 -- 172.21.15.26:0/3121671218 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff2140193b0 con 0x7ff22415d8e0 2023-09-28T00:15:35.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.565+0000 7fdfd652d700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfd00aaba0 0x7fdfd00aaf70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000c410 tx=0x7fdfc0007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.565+0000 7ff20bfff700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff210067330 0x7ff2100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.565+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a8064050 con 0x7fd6a80a6de0 2023-09-28T00:15:35.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.565+0000 7ff20bfff700 1 -- 172.21.15.26:0/3121671218 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff21408e350 con 0x7ff22415d8e0 2023-09-28T00:15:35.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.565+0000 7fdfc67fc700 1 -- 172.21.15.26:0/3995502599 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0011590 con 0x7fdfd00aaba0 2023-09-28T00:15:35.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.565+0000 7fdfc67fc700 1 -- 172.21.15.26:0/3995502599 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc00116f0 con 0x7fdfd00aaba0 2023-09-28T00:15:35.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.565+0000 7fdfc67fc700 1 -- 172.21.15.26:0/3995502599 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0011ab0 con 0x7fdfd00aaba0 2023-09-28T00:15:35.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.565+0000 7ff223fff700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff210067330 0x7ff2100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.566+0000 7ff223fff700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff210067330 0x7ff2100697e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff218009f00 tx=0x7ff218009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.566+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd0149570 con 0x7fdfd00aaba0 2023-09-28T00:15:35.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.566+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd0148870 con 0x7fdfd00aaba0 2023-09-28T00:15:35.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.567+0000 7f73f6cb8700 1 Processor -- start 2023-09-28T00:15:35.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.567+0000 7f73f6cb8700 1 -- start start 2023-09-28T00:15:35.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.568+0000 7f73f6cb8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f00ab3b0 0x7f73f0156220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.568+0000 7f73f6cb8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f00adf70 con 0x7f73f006f610 2023-09-28T00:15:35.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.568+0000 7f73f6cb8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f00ad360 con 0x7f73f00cb980 2023-09-28T00:15:35.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.568+0000 7f73f6cb8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00b0e00 con 0x7f73f00ab3b0 2023-09-28T00:15:35.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.568+0000 7f73f4a54700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f73f00cb980 0x7f73f00ae400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:48684/0 (socket says 172.21.15.26:48684) 2023-09-28T00:15:35.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.568+0000 7f73f4a54700 1 -- 172.21.15.26:0/2687526848 learned_addr learned my addr 172.21.15.26:0/2687526848 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:35.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.568+0000 7fdfc67fc700 1 -- 172.21.15.26:0/3995502599 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fdfc001c460 con 0x7fdfd00aaba0 2023-09-28T00:15:35.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.568+0000 7f73effff700 1 --2- 172.21.15.26:0/2687526848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f00ab3b0 0x7f73f0156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.569+0000 7f73effff700 1 -- 172.21.15.26:0/2687526848 >> v1:172.21.15.190:6789/0 conn(0x7f73f00cb980 legacy=0x7f73f00ae400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.569+0000 7f73effff700 1 -- 172.21.15.26:0/2687526848 >> v1:172.21.15.26:6789/0 conn(0x7f73f006f610 legacy=0x7f73f00b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:35.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.569+0000 7f73effff700 1 -- 172.21.15.26:0/2687526848 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f00ad640 con 0x7f73f00ab3b0 2023-09-28T00:15:35.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.569+0000 7fdfc67fc700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fdfb4067400 0x7fdfb40698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.569+0000 7f73effff700 1 --2- 172.21.15.26:0/2687526848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f00ab3b0 0x7f73f0156220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009910 tx=0x7f73e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac873eb3143076e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.569+0000 7fdfc67fc700 1 -- 172.21.15.26:0/3995502599 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdfc00847a0 con 0x7fdfd00aaba0 2023-09-28T00:15:35.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.570+0000 7ff20bfff700 1 -- 172.21.15.26:0/3121671218 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff22417a1f0 con 0x7ff22415d8e0 2023-09-28T00:15:35.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.571+0000 7fdfd5d2c700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fdfb4067400 0x7fdfb40698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.571+0000 7fdfd5d2c700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fdfb4067400 0x7fdfb40698b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfd004c860 tx=0x7fdfcc015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.573+0000 7f73ef7fe700 1 -- 172.21.15.26:0/2687526848 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400b820 con 0x7f73f00ab3b0 2023-09-28T00:15:35.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.573+0000 7f73ef7fe700 1 -- 172.21.15.26:0/2687526848 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400b980 con 0x7f73f00ab3b0 2023-09-28T00:15:35.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.573+0000 7f73ef7fe700 1 -- 172.21.15.26:0/2687526848 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400bd40 con 0x7f73f00ab3b0 2023-09-28T00:15:35.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.574+0000 7f73f6cb8700 1 -- 172.21.15.26:0/2687526848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f00ab3b0 msgr2=0x7f73f0156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.574+0000 7f73f6cb8700 1 --2- 172.21.15.26:0/2687526848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f00ab3b0 0x7f73f0156220 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009910 tx=0x7f73e40091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.578+0000 7f73f6cb8700 1 -- 172.21.15.26:0/2687526848 shutdown_connections 2023-09-28T00:15:35.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.578+0000 7f73f6cb8700 1 --2- 172.21.15.26:0/2687526848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f00ab3b0 0x7f73f0156220 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.578+0000 7f73f6cb8700 1 -- 172.21.15.26:0/2687526848 >> 172.21.15.26:0/2687526848 conn(0x7f73f0068b90 msgr2=0x7f73f00694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.578+0000 7fd6acf88700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd68c067380 0x7fd68c069830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.578+0000 7f73f6cb8700 1 -- 172.21.15.26:0/2687526848 shutdown_connections 2023-09-28T00:15:35.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.578+0000 7fd6a4ff9700 1 -- 172.21.15.26:0/878022427 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd69c050f90 con 0x7fd6a80a6de0 2023-09-28T00:15:35.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.578+0000 7f73f6cb8700 1 -- 172.21.15.26:0/2687526848 wait complete. 2023-09-28T00:15:35.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.580+0000 7f73f6cb8700 1 Processor -- start 2023-09-28T00:15:35.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.580+0000 7f73f6cb8700 1 -- start start 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.581+0000 7f73f6cb8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f006f610 0x7f73f00aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.581+0000 7f73f6cb8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73f00ab3b0 0x7f73f0155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.581+0000 7f73f6cb8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73f00cb980 0x7f73f0155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.581+0000 7f73f6cb8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f01560a0 con 0x7f73f00cb980 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.581+0000 7f73f6cb8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00ca890 con 0x7f73f00ab3b0 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.581+0000 7f73f6cb8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f009c460 con 0x7f73f006f610 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.581+0000 7f73f4a54700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f006f610 0x7f73f00aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.581+0000 7f73f4a54700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f006f610 0x7f73f00aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34684/0 (socket says 172.21.15.26:34684) 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.581+0000 7f73f4a54700 1 -- 172.21.15.26:0/3391270855 learned_addr learned my addr 172.21.15.26:0/3391270855 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73effff700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73f00ab3b0 0x7f73f0155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73f4a54700 1 -- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73f00ab3b0 msgr2=0x7f73f0155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73f4a54700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73f00ab3b0 0x7f73f0155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73f4a54700 1 -- 172.21.15.26:0/3391270855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73f00cb980 msgr2=0x7f73f0155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73f4a54700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73f00cb980 0x7f73f0155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73f4a54700 1 -- 172.21.15.26:0/3391270855 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4009420 con 0x7f73f006f610 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73f4a54700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f006f610 0x7f73f00aa310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f73e8002280 tx=0x7f73e8001a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73ecff9700 1 -- 172.21.15.26:0/3391270855 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800a8e0 con 0x7f73f006f610 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73ecff9700 1 -- 172.21.15.26:0/3391270855 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e800aa40 con 0x7f73f006f610 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7f73ecff9700 1 -- 172.21.15.26:0/3391270855 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800ae00 con 0x7f73f006f610 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.583+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f009c740 con 0x7f73f006f610 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.583+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f009cd00 con 0x7f73f006f610 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.585+0000 7f73ecff9700 1 -- 172.21.15.26:0/3391270855 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f73e8012610 con 0x7f73f006f610 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.585+0000 7f73ecff9700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f73dc067330 0x7f73dc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:35.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.585+0000 7f73ecff9700 1 -- 172.21.15.26:0/3391270855 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f73e8084e80 con 0x7f73f006f610 2023-09-28T00:15:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.582+0000 7fd6acf88700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd68c067380 0x7fd68c069830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd6940099e0 tx=0x7fd694016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.593+0000 7f73effff700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f73dc067330 0x7f73dc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:35.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.593+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd0148a60 con 0x7fdfd00aaba0 2023-09-28T00:15:35.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.594+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d00052b0 con 0x7f73f006f610 2023-09-28T00:15:35.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.594+0000 7f73effff700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f73dc067330 0x7f73dc0697e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009910 tx=0x7f73e4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:35.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.598+0000 7fdfc67fc700 1 -- 172.21.15.26:0/3995502599 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fdfc0051700 con 0x7fdfd00aaba0 2023-09-28T00:15:35.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.598+0000 7f73ecff9700 1 -- 172.21.15.26:0/3391270855 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f73e8051de0 con 0x7f73f006f610 2023-09-28T00:15:35.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.933+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f5c150130 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.947 INFO:teuthology.orchestra.run.smithi026.stdout:55834574857 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.944+0000 7f3f43fff700 1 -- 172.21.15.26:0/930758039 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f4c055500 con 0x7f3f5c14ebd0 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f3f48067400 msgr2=0x7f3f480698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f3f48067400 0x7f3f480698b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f50006fd0 tx=0x7f3f50015000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f5c14ebd0 msgr2=0x7f3f5c14d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f5c14ebd0 0x7f3f5c14d9b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00b4c0 tx=0x7f3f4c009060 comp rx=0 tx=0).stop 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 shutdown_connections 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f3f48067400 0x7f3f480698b0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3f50006fd0 tx=0x7f3f50015000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3f5c153750 0x7f3f5c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f44003ae0 0x7f3f5c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 --2- 172.21.15.26:0/930758039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3f5c14ebd0 0x7f3f5c14d9b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 >> 172.21.15.26:0/930758039 conn(0x7f3f5c068b90 msgr2=0x7f3f5c069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff22417a1f0 con 0x7ff22415d8e0 2023-09-28T00:15:35.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 shutdown_connections 2023-09-28T00:15:35.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7f3f62401700 1 -- 172.21.15.26:0/930758039 wait complete. 2023-09-28T00:15:35.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.951+0000 7ff20bfff700 1 -- 172.21.15.26:0/3121671218 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff22417a1f0 con 0x7ff22415d8e0 2023-09-28T00:15:35.964 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-09-28T00:15:35.964 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.963+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc9e015bde0 con 0x7fc9e00aaf10 2023-09-28T00:15:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7fc9c77fe700 1 -- 172.21.15.26:0/3817266880 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc9d00550d0 con 0x7fc9e00aaf10 2023-09-28T00:15:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff210067330 msgr2=0x7ff2100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff210067330 0x7ff2100697e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff218009f00 tx=0x7ff218009120 comp rx=0 tx=0).stop 2023-09-28T00:15:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff22415d8e0 msgr2=0x7ff2241762b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.965 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff22415d8e0 0x7ff2241762b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff22406a270 tx=0x7ff214017000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 shutdown_connections 2023-09-28T00:15:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff210067330 0x7ff2100697e0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff218009f00 tx=0x7ff218009120 comp rx=0 tx=0).stop 2023-09-28T00:15:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff224069930 0x7ff2240689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2240b3fd0 0x7ff22414b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 --2- 172.21.15.26:0/3121671218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff22415d8e0 0x7ff2241762b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.966 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.964+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 >> 172.21.15.26:0/3121671218 conn(0x7ff224067630 msgr2=0x7ff2240b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.966 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-09-28T00:15:35.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.966+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 shutdown_connections 2023-09-28T00:15:35.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.966+0000 7ff22a356700 1 -- 172.21.15.26:0/3121671218 wait complete. 2023-09-28T00:15:35.968 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.967+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f743c0cce80 con 0x7f743c15dc60 2023-09-28T00:15:35.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.970+0000 7f7422ffd700 1 -- 172.21.15.26:0/1826299463 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7434018020 con 0x7f743c15dc60 2023-09-28T00:15:35.971 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-09-28T00:15:35.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-09-28T00:15:35.973 DEBUG:teuthology.parallel:result is None 2023-09-28T00:15:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7428067360 msgr2=0x7f7428069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7428067360 0x7f7428069810 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7430006fd0 tx=0x7f74300090f0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f743c15dc60 msgr2=0x7f743c149350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f743c15dc60 0x7f743c149350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7434009e50 tx=0x7f743400b040 comp rx=0 tx=0).stop 2023-09-28T00:15:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 shutdown_connections 2023-09-28T00:15:35.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7428067360 0x7f7428069810 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f743c0b4b90 0x7f743c142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f743c15dc60 0x7f743c149350 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 --2- 172.21.15.26:0/1826299463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f743c15d890 0x7f743c148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 >> 172.21.15.26:0/1826299463 conn(0x7f743c0680b0 msgr2=0x7f743c0b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 shutdown_connections 2023-09-28T00:15:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.973+0000 7f744161e700 1 -- 172.21.15.26:0/1826299463 wait complete. 2023-09-28T00:15:35.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.974+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8478064050 con 0x7f8478159500 2023-09-28T00:15:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.974+0000 7f846f7fe700 1 -- 172.21.15.26:0/1237022044 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8460055200 con 0x7f8478159500 2023-09-28T00:15:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.975+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc9cc067360 msgr2=0x7fc9cc069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.975+0000 7fc9e5f6a700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc9cc067360 0x7fc9cc069810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc9d400bfd0 tx=0x7fc9d401b000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.975+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00aaf10 msgr2=0x7fc9e0176570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.975+0000 7fc9e5f6a700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00aaf10 0x7fc9e0176570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc9d0001860 tx=0x7fc9d0007e20 comp rx=0 tx=0).stop 2023-09-28T00:15:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.975+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f73d0005830 con 0x7f73f006f610 2023-09-28T00:15:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.976+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 shutdown_connections 2023-09-28T00:15:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.976+0000 7fc9e5f6a700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc9cc067360 0x7fc9cc069810 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.976+0000 7fc9e5f6a700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9c8003e00 0x7fc9e0159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.976+0000 7fc9e5f6a700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc9e00a8640 0x7fc9e00a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.976+0000 7fc9e5f6a700 1 --2- 172.21.15.26:0/3817266880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9e00aaf10 0x7fc9e0176570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.976+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 >> 172.21.15.26:0/3817266880 conn(0x7fc9e006be70 msgr2=0x7fc9e0152520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.976+0000 7f73ecff9700 1 -- 172.21.15.26:0/3391270855 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f73e8055400 con 0x7f73f006f610 2023-09-28T00:15:35.978 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2023-09-28T00:15:35.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.978+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 shutdown_connections 2023-09-28T00:15:35.979 INFO:teuthology.orchestra.run.smithi026.stdout:60129542151 2023-09-28T00:15:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.978+0000 7fc9e5f6a700 1 -- 172.21.15.26:0/3817266880 wait complete. 2023-09-28T00:15:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.979+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8458067330 msgr2=0x7f84580697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.979+0000 7f847d5ba700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8458067330 0x7f84580697e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8468009fd0 tx=0x7f8468018000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.979+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8478159500 msgr2=0x7f84780b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.979+0000 7f847d5ba700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8478159500 0x7f84780b5ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f846000ea50 tx=0x7f8460009250 comp rx=0 tx=0).stop 2023-09-28T00:15:35.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f73dc067330 msgr2=0x7f73dc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f73dc067330 0x7f73dc0697e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009910 tx=0x7f73e4016000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f006f610 msgr2=0x7f73f00aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f006f610 0x7f73f00aa310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f73e8002280 tx=0x7f73e8001a80 comp rx=0 tx=0).stop 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 shutdown_connections 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f73dc067330 0x7f73dc0697e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f73f006f610 0x7f73f00aa310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f73f00cb980 0x7f73f0155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 --2- 172.21.15.26:0/3391270855 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f73f00ab3b0 0x7f73f0155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 >> 172.21.15.26:0/3391270855 conn(0x7f73f0068b90 msgr2=0x7f73f0069a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 shutdown_connections 2023-09-28T00:15:35.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.981+0000 7f73f6cb8700 1 -- 172.21.15.26:0/3391270855 wait complete. 2023-09-28T00:15:35.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.984+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd6a80a4140 con 0x7fd6a80a6de0 2023-09-28T00:15:35.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.985+0000 7fd6a4ff9700 1 -- 172.21.15.26:0/878022427 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd69c017030 con 0x7fd6a80a6de0 2023-09-28T00:15:35.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2023-09-28T00:15:35.987 INFO:teuthology.orchestra.run.smithi026.stdout:60129542152 2023-09-28T00:15:35.987 DEBUG:teuthology.parallel:result is None 2023-09-28T00:15:35.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd68c067380 msgr2=0x7fd68c069830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd68c067380 0x7fd68c069830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd6940099e0 tx=0x7fd694016000 comp rx=0 tx=0).stop 2023-09-28T00:15:35.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a80a6de0 msgr2=0x7fd6a8154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:35.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a80a6de0 0x7fd6a8154950 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00c7f0 tx=0x7fd69c007da0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 shutdown_connections 2023-09-28T00:15:35.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd68c067380 0x7fd68c069830 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6a81597d0 0x7fd6a80ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6a806ed20 0x7fd6a8154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 --2- 172.21.15.26:0/878022427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6a80a6de0 0x7fd6a8154950 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00c7f0 tx=0x7fd69c007da0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.988+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 >> 172.21.15.26:0/878022427 conn(0x7fd6a80680b0 msgr2=0x7fd6a80991a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.989+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 shutdown_connections 2023-09-28T00:15:35.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.989+0000 7f847d5ba700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f8458067330 0x7f84580697e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.990 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.989+0000 7f847d5ba700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f847815d8e0 0x7f847816b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.989+0000 7f847d5ba700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f84780b3fd0 0x7f847816d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.989+0000 7f847d5ba700 1 --2- 172.21.15.26:0/1237022044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8478159500 0x7f84780b5ab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:35.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.989+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 >> 172.21.15.26:0/1237022044 conn(0x7f8478067630 msgr2=0x7f847814d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:35.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.991+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 shutdown_connections 2023-09-28T00:15:35.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.991+0000 7f847d5ba700 1 -- 172.21.15.26:0/1237022044 wait complete. 2023-09-28T00:15:35.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.992+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 shutdown_connections 2023-09-28T00:15:35.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.992+0000 7fd6af1ec700 1 -- 172.21.15.26:0/878022427 wait complete. 2023-09-28T00:15:35.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-09-28T00:15:35.995 DEBUG:teuthology.parallel:result is None 2023-09-28T00:15:35.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.995+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdfd0064050 con 0x7fdfd00aaba0 2023-09-28T00:15:35.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.996+0000 7fdfc67fc700 1 -- 172.21.15.26:0/3995502599 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfc0054d20 con 0x7fdfd00aaba0 2023-09-28T00:15:35.997 INFO:teuthology.orchestra.run.smithi026.stdout:55834574855 2023-09-28T00:15:35.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-09-28T00:15:35.998 DEBUG:teuthology.parallel:result is None 2023-09-28T00:15:35.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fdfb4067400 msgr2=0x7fdfb40698b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fdfb4067400 0x7fdfb40698b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfd004c860 tx=0x7fdfcc015000 comp rx=0 tx=0).stop 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfd00aaba0 msgr2=0x7fdfd00aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfd00aaba0 0x7fdfd00aaf70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000c410 tx=0x7fdfc0007ea0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 shutdown_connections 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fdfb4067400 0x7fdfb40698b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfd01483f0 0x7fdfd0149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdfd00aaba0 0x7fdfd00aaf70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 --2- 172.21.15.26:0/3995502599 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdfd015ab00 0x7fdfd014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 >> 172.21.15.26:0/3995502599 conn(0x7fdfd006e910 msgr2=0x7fdfd00b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 shutdown_connections 2023-09-28T00:15:36.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:35.998+0000 7fdfd8791700 1 -- 172.21.15.26:0/3995502599 wait complete. 2023-09-28T00:15:36.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.5 2023-09-28T00:15:36.003 DEBUG:teuthology.parallel:result is None 2023-09-28T00:15:36.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-09-28T00:15:36.014 DEBUG:teuthology.parallel:result is None 2023-09-28T00:15:36.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-09-28T00:15:36.015 DEBUG:teuthology.parallel:result is None 2023-09-28T00:15:36.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2023-09-28T00:15:36.016 DEBUG:teuthology.parallel:result is None 2023-09-28T00:15:36.016 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-28T00:15:36.016 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:15:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.172+0000 7f4135af5700 1 Processor -- start 2023-09-28T00:15:36.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.173+0000 7f4135af5700 1 -- start start 2023-09-28T00:15:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.173+0000 7f4135af5700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f413015d560 0x7f41300d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.173+0000 7f4135af5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41301591b0 0x7f4130159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.173+0000 7f4135af5700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41300b2ad0 con 0x7f413015d930 2023-09-28T00:15:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.173+0000 7f4135af5700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41300b4160 con 0x7f413015d560 2023-09-28T00:15:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.173+0000 7f4135af5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4130159b70 con 0x7f41301591b0 2023-09-28T00:15:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.173+0000 7f412effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f413015d930 0x7f41300b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44024/0 (socket says 172.21.15.26:44024) 2023-09-28T00:15:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.173+0000 7f412effd700 1 -- 172.21.15.26:0/4173345767 learned_addr learned my addr 172.21.15.26:0/4173345767 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412ffff700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41301591b0 0x7f4130159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412f7fe700 1 --2- 172.21.15.26:0/4173345767 >> v2:172.21.15.190:3300/0 conn(0x7f413015d560 0x7f41300d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959808494 0 0) 0x7f41300b2ad0 con 0x7f413015d930 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f411c003570 con 0x7f413015d930 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 747572999 0 0) 0x7f411c003570 con 0x7f413015d930 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41301591b0 msgr2=0x7f4130159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41301591b0 0x7f4130159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 >> v2:172.21.15.190:3300/0 conn(0x7f413015d560 msgr2=0x7f41300d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 --2- 172.21.15.26:0/4173345767 >> v2:172.21.15.190:3300/0 conn(0x7f413015d560 0x7f41300d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41300b2230 con 0x7f413015d930 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7f4118001470 con 0x7f413015d930 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 >> v1:172.21.15.26:6789/0 conn(0x7f413015d930 legacy=0x7f41300b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41301591b0 0x7f411c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f411c003fe0 0x7f411c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c004d50 0x7f411c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300b4160 con 0x7f411c004d50 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130159b70 con 0x7f411c003fe0 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c00ba90 con 0x7f41301591b0 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412ffff700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c004d50 0x7f411c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412f7fe700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41301591b0 0x7f411c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412effd700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f411c003fe0 0x7f411c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412ffff700 1 -- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41301591b0 msgr2=0x7f411c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.174+0000 7f412ffff700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f41301591b0 0x7f411c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f412ffff700 1 -- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f411c003fe0 msgr2=0x7f411c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:36.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f412ffff700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f411c003fe0 0x7f411c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f412ffff700 1 -- 172.21.15.26:0/4173345767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c003570 con 0x7f411c004d50 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f412ffff700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c004d50 0x7f411c0051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f412800e210 tx=0x7f412800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d872910cb15b0345 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412800ea60 con 0x7f411c004d50 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412800f040 con 0x7f411c004d50 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f412e7fc700 1 -- 172.21.15.26:0/4173345767 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412800ee10 con 0x7f411c004d50 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f4135af5700 1 -- 172.21.15.26:0/4173345767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c004d50 msgr2=0x7f411c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f4135af5700 1 --2- 172.21.15.26:0/4173345767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f411c004d50 0x7f411c0051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f412800e210 tx=0x7f412800b040 comp rx=0 tx=0).stop 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f412ffff700 1 -- 172.21.15.26:0/4173345767 reap_dead start 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f4135af5700 1 -- 172.21.15.26:0/4173345767 shutdown_connections 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f4135af5700 1 -- 172.21.15.26:0/4173345767 >> 172.21.15.26:0/4173345767 conn(0x7f41300d1180 msgr2=0x7f4130069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f4135af5700 1 -- 172.21.15.26:0/4173345767 shutdown_connections 2023-09-28T00:15:36.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.175+0000 7f4135af5700 1 -- 172.21.15.26:0/4173345767 wait complete. 2023-09-28T00:15:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.177+0000 7f4135af5700 1 Processor -- start 2023-09-28T00:15:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.177+0000 7f4135af5700 1 -- start start 2023-09-28T00:15:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f4135af5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f411c004d50 0x7f4130154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f4135af5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4130151af0 0x7f413014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f4135af5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f413016ce90 0x7f413016d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f4135af5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413016d870 con 0x7f413016ce90 2023-09-28T00:15:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f4135af5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413014e5c0 con 0x7f411c004d50 2023-09-28T00:15:36.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f4135af5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4130152300 con 0x7f4130151af0 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f413016ce90 0x7f413016d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f413016ce90 0x7f413016d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46690/0 (socket says 172.21.15.26:46690) 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412ffff700 1 -- 172.21.15.26:0/126383484 learned_addr learned my addr 172.21.15.26:0/126383484 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412effd700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4130151af0 0x7f413014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412f7fe700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f411c004d50 0x7f4130154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412ffff700 1 -- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4130151af0 msgr2=0x7f413014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412ffff700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4130151af0 0x7f413014d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412ffff700 1 -- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f411c004d50 msgr2=0x7f4130154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412ffff700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f411c004d50 0x7f4130154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412ffff700 1 -- 172.21.15.26:0/126383484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41301525e0 con 0x7f413016ce90 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f412ffff700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f413016ce90 0x7f413016d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f411c004730 tx=0x7f412801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:36.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f41277fe700 1 -- 172.21.15.26:0/126383484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412800eee0 con 0x7f413016ce90 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f41277fe700 1 -- 172.21.15.26:0/126383484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4128022070 con 0x7f413016ce90 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f41277fe700 1 -- 172.21.15.26:0/126383484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4128027680 con 0x7f413016ce90 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413014e250 con 0x7f413016ce90 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.178+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413015b000 con 0x7f413016ce90 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.179+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4130064050 con 0x7f413016ce90 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.180+0000 7f41277fe700 1 -- 172.21.15.26:0/126383484 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4128024030 con 0x7f413016ce90 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.180+0000 7f41277fe700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4110067330 0x7f41100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.180+0000 7f41277fe700 1 -- 172.21.15.26:0/126383484 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f41280863a0 con 0x7f413016ce90 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.180+0000 7f412f7fe700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4110067330 0x7f41100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.181+0000 7f412f7fe700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4110067330 0x7f41100697e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4120006f00 tx=0x7f41200091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:36.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.184+0000 7f41277fe700 1 -- 172.21.15.26:0/126383484 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f41280532a0 con 0x7f413016ce90 2023-09-28T00:15:36.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.374+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f413014e0d0 con 0x7f4110067330 2023-09-28T00:15:36.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.382+0000 7f41277fe700 1 -- 172.21.15.26:0/126383484 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284640 (secure 0 0 0) 0x7f4120019070 con 0x7f4110067330 2023-09-28T00:15:36.386 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:36.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4110067330 msgr2=0x7f41100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4110067330 0x7f41100697e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4120006f00 tx=0x7f41200091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f413016ce90 msgr2=0x7f413016d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f413016ce90 0x7f413016d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f411c004730 tx=0x7f412801a000 comp rx=0 tx=0).stop 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 shutdown_connections 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4110067330 0x7f41100697e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f413016ce90 0x7f413016d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f411c004d50 0x7f4130154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 --2- 172.21.15.26:0/126383484 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4130151af0 0x7f413014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 >> 172.21.15.26:0/126383484 conn(0x7f41300d1180 msgr2=0x7f41300afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 shutdown_connections 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.385+0000 7f4135af5700 1 -- 172.21.15.26:0/126383484 wait complete. 2023-09-28T00:15:36.389 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:15:36.398 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-09-28T00:15:35.668904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66344,"kb_used_data":3176,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908376,"statfs":{"total":773094113280,"available":773026177024,"internally_reserved":0,"allocated":3252224,"data_stored":1930452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.701738"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393167+0000","last_change":"2023-09-28T00:15:29.392083+0000","last_active":"2023-09-28T00:15:29.393167+0000","last_peered":"2023-09-28T00:15:29.393167+0000","last_clean":"2023-09-28T00:15:29.393167+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:15:29.393167+0000","last_undegraded":"2023-09-28T00:15:29.393167+0000","last_fullsized":"2023-09-28T00:15:29.393167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:53.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391806+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:15:29.391806+0000","last_peered":"2023-09-28T00:15:29.391806+0000","last_clean":"2023-09-28T00:15:29.391806+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:15:29.391806+0000","last_undegraded":"2023-09-28T00:15:29.391806+0000","last_fullsized":"2023-09-28T00:15:29.391806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404174+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:15:29.404174+0000","last_peered":"2023-09-28T00:15:29.404174+0000","last_clean":"2023-09-28T00:15:29.404174+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:15:29.404174+0000","last_undegraded":"2023-09-28T00:15:29.404174+0000","last_fullsized":"2023-09-28T00:15:29.404174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:31:15.779086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394940+0000","last_change":"2023-09-28T00:15:29.387338+0000","last_active":"2023-09-28T00:15:29.394940+0000","last_peered":"2023-09-28T00:15:29.394940+0000","last_clean":"2023-09-28T00:15:29.394940+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:15:29.394940+0000","last_undegraded":"2023-09-28T00:15:29.394940+0000","last_fullsized":"2023-09-28T00:15:29.394940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:11.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402390+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:15:29.402390+0000","last_peered":"2023-09-28T00:15:29.402390+0000","last_clean":"2023-09-28T00:15:29.402390+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:15:29.402390+0000","last_undegraded":"2023-09-28T00:15:29.402390+0000","last_fullsized":"2023-09-28T00:15:29.402390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403262+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:15:29.403262+0000","last_peered":"2023-09-28T00:15:29.403262+0000","last_clean":"2023-09-28T00:15:29.403262+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:15:29.403262+0000","last_undegraded":"2023-09-28T00:15:29.403262+0000","last_fullsized":"2023-09-28T00:15:29.403262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:10.975572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390765+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:15:29.390765+0000","last_peered":"2023-09-28T00:15:29.390765+0000","last_clean":"2023-09-28T00:15:29.390765+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:15:29.390765+0000","last_undegraded":"2023-09-28T00:15:29.390765+0000","last_fullsized":"2023-09-28T00:15:29.390765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399845+0000","last_change":"2023-09-28T00:15:29.398742+0000","last_active":"2023-09-28T00:15:29.399845+0000","last_peered":"2023-09-28T00:15:29.399845+0000","last_clean":"2023-09-28T00:15:29.399845+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:15:29.399845+0000","last_undegraded":"2023-09-28T00:15:29.399845+0000","last_fullsized":"2023-09-28T00:15:29.399845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402654+0000","last_change":"2023-09-28T00:15:29.401666+0000","last_active":"2023-09-28T00:15:29.402654+0000","last_peered":"2023-09-28T00:15:29.402654+0000","last_clean":"2023-09-28T00:15:29.402654+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:15:29.402654+0000","last_undegraded":"2023-09-28T00:15:29.402654+0000","last_fullsized":"2023-09-28T00:15:29.402654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394457+0000","last_change":"2023-09-28T00:15:29.388253+0000","last_active":"2023-09-28T00:15:29.394457+0000","last_peered":"2023-09-28T00:15:29.394457+0000","last_clean":"2023-09-28T00:15:29.394457+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:15:29.394457+0000","last_undegraded":"2023-09-28T00:15:29.394457+0000","last_fullsized":"2023-09-28T00:15:29.394457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397977+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:15:29.397977+0000","last_peered":"2023-09-28T00:15:29.397977+0000","last_clean":"2023-09-28T00:15:29.397977+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:15:29.397977+0000","last_undegraded":"2023-09-28T00:15:29.397977+0000","last_fullsized":"2023-09-28T00:15:29.397977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400172+0000","last_change":"2023-09-28T00:15:29.399521+0000","last_active":"2023-09-28T00:15:29.400172+0000","last_peered":"2023-09-28T00:15:29.400172+0000","last_clean":"2023-09-28T00:15:29.400172+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:15:29.400172+0000","last_undegraded":"2023-09-28T00:15:29.400172+0000","last_fullsized":"2023-09-28T00:15:29.400172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:38.462117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393250+0000","last_change":"2023-09-28T00:15:29.392028+0000","last_active":"2023-09-28T00:15:29.393250+0000","last_peered":"2023-09-28T00:15:29.393250+0000","last_clean":"2023-09-28T00:15:29.393250+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:15:29.393250+0000","last_undegraded":"2023-09-28T00:15:29.393250+0000","last_fullsized":"2023-09-28T00:15:29.393250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397374+0000","last_change":"2023-09-28T00:15:29.394175+0000","last_active":"2023-09-28T00:15:29.397374+0000","last_peered":"2023-09-28T00:15:29.397374+0000","last_clean":"2023-09-28T00:15:29.397374+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:15:29.397374+0000","last_undegraded":"2023-09-28T00:15:29.397374+0000","last_fullsized":"2023-09-28T00:15:29.397374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394506+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:15:29.394506+0000","last_peered":"2023-09-28T00:15:29.394506+0000","last_clean":"2023-09-28T00:15:29.394506+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:15:29.394506+0000","last_undegraded":"2023-09-28T00:15:29.394506+0000","last_fullsized":"2023-09-28T00:15:29.394506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398296+0000","last_change":"2023-09-28T00:15:29.397273+0000","last_active":"2023-09-28T00:15:29.398296+0000","last_peered":"2023-09-28T00:15:29.398296+0000","last_clean":"2023-09-28T00:15:29.398296+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:15:29.398296+0000","last_undegraded":"2023-09-28T00:15:29.398296+0000","last_fullsized":"2023-09-28T00:15:29.398296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402636+0000","last_change":"2023-09-28T00:15:29.401695+0000","last_active":"2023-09-28T00:15:29.402636+0000","last_peered":"2023-09-28T00:15:29.402636+0000","last_clean":"2023-09-28T00:15:29.402636+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:15:29.402636+0000","last_undegraded":"2023-09-28T00:15:29.402636+0000","last_fullsized":"2023-09-28T00:15:29.402636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400097+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:15:29.400097+0000","last_peered":"2023-09-28T00:15:29.400097+0000","last_clean":"2023-09-28T00:15:29.400097+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:15:29.400097+0000","last_undegraded":"2023-09-28T00:15:29.400097+0000","last_fullsized":"2023-09-28T00:15:29.400097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391545+0000","last_change":"2023-09-28T00:15:29.386237+0000","last_active":"2023-09-28T00:15:29.391545+0000","last_peered":"2023-09-28T00:15:29.391545+0000","last_clean":"2023-09-28T00:15:29.391545+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:15:29.391545+0000","last_undegraded":"2023-09-28T00:15:29.391545+0000","last_fullsized":"2023-09-28T00:15:29.391545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403381+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:15:29.403381+0000","last_peered":"2023-09-28T00:15:29.403381+0000","last_clean":"2023-09-28T00:15:29.403381+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:15:29.403381+0000","last_undegraded":"2023-09-28T00:15:29.403381+0000","last_fullsized":"2023-09-28T00:15:29.403381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:49:33.646923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394054+0000","last_change":"2023-09-28T00:15:29.392231+0000","last_active":"2023-09-28T00:15:29.394054+0000","last_peered":"2023-09-28T00:15:29.394054+0000","last_clean":"2023-09-28T00:15:29.394054+0000","last_became_active":"2023-09-28T00:15:29.391855+0000","last_became_peered":"2023-09-28T00:15:29.391855+0000","last_unstale":"2023-09-28T00:15:29.394054+0000","last_undegraded":"2023-09-28T00:15:29.394054+0000","last_fullsized":"2023-09-28T00:15:29.394054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.401694+0000","last_change":"2023-09-28T00:15:29.394242+0000","last_active":"2023-09-28T00:15:29.401694+0000","last_peered":"2023-09-28T00:15:29.401694+0000","last_clean":"2023-09-28T00:15:29.401694+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:15:29.401694+0000","last_undegraded":"2023-09-28T00:15:29.401694+0000","last_fullsized":"2023-09-28T00:15:29.401694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391666+0000","last_change":"2023-09-28T00:15:29.389082+0000","last_active":"2023-09-28T00:15:29.391666+0000","last_peered":"2023-09-28T00:15:29.391666+0000","last_clean":"2023-09-28T00:15:29.391666+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:15:29.391666+0000","last_undegraded":"2023-09-28T00:15:29.391666+0000","last_fullsized":"2023-09-28T00:15:29.391666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394025+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:15:29.394025+0000","last_peered":"2023-09-28T00:15:29.394025+0000","last_clean":"2023-09-28T00:15:29.394025+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:15:29.394025+0000","last_undegraded":"2023-09-28T00:15:29.394025+0000","last_fullsized":"2023-09-28T00:15:29.394025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398162+0000","last_change":"2023-09-28T00:15:29.392586+0000","last_active":"2023-09-28T00:15:29.398162+0000","last_peered":"2023-09-28T00:15:29.398162+0000","last_clean":"2023-09-28T00:15:29.398162+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:15:29.398162+0000","last_undegraded":"2023-09-28T00:15:29.398162+0000","last_fullsized":"2023-09-28T00:15:29.398162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:16:11.243076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386766+0000","last_change":"2023-09-28T00:15:29.384837+0000","last_active":"2023-09-28T00:15:29.386766+0000","last_peered":"2023-09-28T00:15:29.386766+0000","last_clean":"2023-09-28T00:15:29.386766+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:15:29.386766+0000","last_undegraded":"2023-09-28T00:15:29.386766+0000","last_fullsized":"2023-09-28T00:15:29.386766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:49:32.973094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398577+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:15:29.398577+0000","last_peered":"2023-09-28T00:15:29.398577+0000","last_clean":"2023-09-28T00:15:29.398577+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:15:29.398577+0000","last_undegraded":"2023-09-28T00:15:29.398577+0000","last_fullsized":"2023-09-28T00:15:29.398577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399602+0000","last_change":"2023-09-28T00:15:28.982899+0000","last_active":"2023-09-28T00:15:29.399602+0000","last_peered":"2023-09-28T00:15:29.399602+0000","last_clean":"2023-09-28T00:15:29.399602+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:15:29.399602+0000","last_undegraded":"2023-09-28T00:15:29.399602+0000","last_fullsized":"2023-09-28T00:15:29.399602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390553+0000","last_change":"2023-09-28T00:15:29.383398+0000","last_active":"2023-09-28T00:15:29.390553+0000","last_peered":"2023-09-28T00:15:29.390553+0000","last_clean":"2023-09-28T00:15:29.390553+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:15:29.390553+0000","last_undegraded":"2023-09-28T00:15:29.390553+0000","last_fullsized":"2023-09-28T00:15:29.390553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380346+0000","last_change":"2023-09-28T00:15:28.984308+0000","last_active":"2023-09-28T00:15:29.380346+0000","last_peered":"2023-09-28T00:15:29.380346+0000","last_clean":"2023-09-28T00:15:29.380346+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:15:29.380346+0000","last_undegraded":"2023-09-28T00:15:29.380346+0000","last_fullsized":"2023-09-28T00:15:29.380346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402446+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:15:29.402446+0000","last_peered":"2023-09-28T00:15:29.402446+0000","last_clean":"2023-09-28T00:15:29.402446+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:15:29.402446+0000","last_undegraded":"2023-09-28T00:15:29.402446+0000","last_fullsized":"2023-09-28T00:15:29.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375855+0000","last_change":"2023-09-28T00:15:28.986600+0000","last_active":"2023-09-28T00:15:29.375855+0000","last_peered":"2023-09-28T00:15:29.375855+0000","last_clean":"2023-09-28T00:15:29.375855+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:15:29.375855+0000","last_undegraded":"2023-09-28T00:15:29.375855+0000","last_fullsized":"2023-09-28T00:15:29.375855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397007+0000","last_change":"2023-09-28T00:15:29.391209+0000","last_active":"2023-09-28T00:15:29.397007+0000","last_peered":"2023-09-28T00:15:29.397007+0000","last_clean":"2023-09-28T00:15:29.397007+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:15:29.397007+0000","last_undegraded":"2023-09-28T00:15:29.397007+0000","last_fullsized":"2023-09-28T00:15:29.397007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394579+0000","last_change":"2023-09-28T00:15:28.990492+0000","last_active":"2023-09-28T00:15:29.394579+0000","last_peered":"2023-09-28T00:15:29.394579+0000","last_clean":"2023-09-28T00:15:29.394579+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:15:29.394579+0000","last_undegraded":"2023-09-28T00:15:29.394579+0000","last_fullsized":"2023-09-28T00:15:29.394579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.387663+0000","last_change":"2023-09-28T00:15:29.381022+0000","last_active":"2023-09-28T00:15:29.387663+0000","last_peered":"2023-09-28T00:15:29.387663+0000","last_clean":"2023-09-28T00:15:29.387663+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:15:29.387663+0000","last_undegraded":"2023-09-28T00:15:29.387663+0000","last_fullsized":"2023-09-28T00:15:29.387663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378888+0000","last_change":"2023-09-28T00:15:28.989043+0000","last_active":"2023-09-28T00:15:29.378888+0000","last_peered":"2023-09-28T00:15:29.378888+0000","last_clean":"2023-09-28T00:15:29.378888+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:15:29.378888+0000","last_undegraded":"2023-09-28T00:15:29.378888+0000","last_fullsized":"2023-09-28T00:15:29.378888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391650+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:15:29.391650+0000","last_peered":"2023-09-28T00:15:29.391650+0000","last_clean":"2023-09-28T00:15:29.391650+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:15:29.391650+0000","last_undegraded":"2023-09-28T00:15:29.391650+0000","last_fullsized":"2023-09-28T00:15:29.391650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399129+0000","last_change":"2023-09-28T00:15:28.981865+0000","last_active":"2023-09-28T00:15:29.399129+0000","last_peered":"2023-09-28T00:15:29.399129+0000","last_clean":"2023-09-28T00:15:29.399129+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:15:29.399129+0000","last_undegraded":"2023-09-28T00:15:29.399129+0000","last_fullsized":"2023-09-28T00:15:29.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397590+0000","last_change":"2023-09-28T00:15:29.389604+0000","last_active":"2023-09-28T00:15:29.397590+0000","last_peered":"2023-09-28T00:15:29.397590+0000","last_clean":"2023-09-28T00:15:29.397590+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:15:29.397590+0000","last_undegraded":"2023-09-28T00:15:29.397590+0000","last_fullsized":"2023-09-28T00:15:29.397590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.405038+0000","last_change":"2023-09-28T00:15:28.979093+0000","last_active":"2023-09-28T00:15:29.405038+0000","last_peered":"2023-09-28T00:15:29.405038+0000","last_clean":"2023-09-28T00:15:29.405038+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:15:29.405038+0000","last_undegraded":"2023-09-28T00:15:29.405038+0000","last_fullsized":"2023-09-28T00:15:29.405038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404103+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:15:29.404103+0000","last_peered":"2023-09-28T00:15:29.404103+0000","last_clean":"2023-09-28T00:15:29.404103+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:15:29.404103+0000","last_undegraded":"2023-09-28T00:15:29.404103+0000","last_fullsized":"2023-09-28T00:15:29.404103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:59:40.497846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403068+0000","last_change":"2023-09-28T00:15:28.985348+0000","last_active":"2023-09-28T00:15:29.403068+0000","last_peered":"2023-09-28T00:15:29.403068+0000","last_clean":"2023-09-28T00:15:29.403068+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:15:29.403068+0000","last_undegraded":"2023-09-28T00:15:29.403068+0000","last_fullsized":"2023-09-28T00:15:29.403068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390525+0000","last_change":"2023-09-28T00:15:29.383322+0000","last_active":"2023-09-28T00:15:29.390525+0000","last_peered":"2023-09-28T00:15:29.390525+0000","last_clean":"2023-09-28T00:15:29.390525+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:15:29.390525+0000","last_undegraded":"2023-09-28T00:15:29.390525+0000","last_fullsized":"2023-09-28T00:15:29.390525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390540+0000","last_change":"2023-09-28T00:15:28.987818+0000","last_active":"2023-09-28T00:15:29.390540+0000","last_peered":"2023-09-28T00:15:29.390540+0000","last_clean":"2023-09-28T00:15:29.390540+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:15:29.390540+0000","last_undegraded":"2023-09-28T00:15:29.390540+0000","last_fullsized":"2023-09-28T00:15:29.390540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397462+0000","last_change":"2023-09-28T00:15:29.395546+0000","last_active":"2023-09-28T00:15:29.397462+0000","last_peered":"2023-09-28T00:15:29.397462+0000","last_clean":"2023-09-28T00:15:29.397462+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:15:29.397462+0000","last_undegraded":"2023-09-28T00:15:29.397462+0000","last_fullsized":"2023-09-28T00:15:29.397462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380953+0000","last_change":"2023-09-28T00:15:28.985438+0000","last_active":"2023-09-28T00:15:29.380953+0000","last_peered":"2023-09-28T00:15:29.380953+0000","last_clean":"2023-09-28T00:15:29.380953+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:15:29.380953+0000","last_undegraded":"2023-09-28T00:15:29.380953+0000","last_fullsized":"2023-09-28T00:15:29.380953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402467+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:15:29.402467+0000","last_peered":"2023-09-28T00:15:29.402467+0000","last_clean":"2023-09-28T00:15:29.402467+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:15:29.402467+0000","last_undegraded":"2023-09-28T00:15:29.402467+0000","last_fullsized":"2023-09-28T00:15:29.402467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403755+0000","last_change":"2023-09-28T00:15:28.983275+0000","last_active":"2023-09-28T00:15:29.403755+0000","last_peered":"2023-09-28T00:15:29.403755+0000","last_clean":"2023-09-28T00:15:29.403755+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:15:29.403755+0000","last_undegraded":"2023-09-28T00:15:29.403755+0000","last_fullsized":"2023-09-28T00:15:29.403755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:10:17.162300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396946+0000","last_change":"2023-09-28T00:15:29.393952+0000","last_active":"2023-09-28T00:15:29.396946+0000","last_peered":"2023-09-28T00:15:29.396946+0000","last_clean":"2023-09-28T00:15:29.396946+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:15:29.396946+0000","last_undegraded":"2023-09-28T00:15:29.396946+0000","last_fullsized":"2023-09-28T00:15:29.396946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402648+0000","last_change":"2023-09-28T00:15:28.986391+0000","last_active":"2023-09-28T00:15:29.402648+0000","last_peered":"2023-09-28T00:15:29.402648+0000","last_clean":"2023-09-28T00:15:29.402648+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:15:29.402648+0000","last_undegraded":"2023-09-28T00:15:29.402648+0000","last_fullsized":"2023-09-28T00:15:29.402648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396755+0000","last_change":"2023-09-28T00:15:29.393474+0000","last_active":"2023-09-28T00:15:29.396755+0000","last_peered":"2023-09-28T00:15:29.396755+0000","last_clean":"2023-09-28T00:15:29.396755+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:15:29.396755+0000","last_undegraded":"2023-09-28T00:15:29.396755+0000","last_fullsized":"2023-09-28T00:15:29.396755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402943+0000","last_change":"2023-09-28T00:15:28.986082+0000","last_active":"2023-09-28T00:15:29.402943+0000","last_peered":"2023-09-28T00:15:29.402943+0000","last_clean":"2023-09-28T00:15:29.402943+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:15:29.402943+0000","last_undegraded":"2023-09-28T00:15:29.402943+0000","last_fullsized":"2023-09-28T00:15:29.402943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:16.392360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397610+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:15:29.397610+0000","last_peered":"2023-09-28T00:15:29.397610+0000","last_clean":"2023-09-28T00:15:29.397610+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:15:29.397610+0000","last_undegraded":"2023-09-28T00:15:29.397610+0000","last_fullsized":"2023-09-28T00:15:29.397610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:11:37.490848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399248+0000","last_change":"2023-09-28T00:15:28.982433+0000","last_active":"2023-09-28T00:15:29.399248+0000","last_peered":"2023-09-28T00:15:29.399248+0000","last_clean":"2023-09-28T00:15:29.399248+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:15:29.399248+0000","last_undegraded":"2023-09-28T00:15:29.399248+0000","last_fullsized":"2023-09-28T00:15:29.399248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:37:52.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395572+0000","last_change":"2023-09-28T00:15:29.388766+0000","last_active":"2023-09-28T00:15:29.395572+0000","last_peered":"2023-09-28T00:15:29.395572+0000","last_clean":"2023-09-28T00:15:29.395572+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:15:29.395572+0000","last_undegraded":"2023-09-28T00:15:29.395572+0000","last_fullsized":"2023-09-28T00:15:29.395572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.381202+0000","last_change":"2023-09-28T00:15:28.984089+0000","last_active":"2023-09-28T00:15:29.381202+0000","last_peered":"2023-09-28T00:15:29.381202+0000","last_clean":"2023-09-28T00:15:29.381202+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:15:29.381202+0000","last_undegraded":"2023-09-28T00:15:29.381202+0000","last_fullsized":"2023-09-28T00:15:29.381202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394391+0000","last_change":"2023-09-28T00:15:29.386850+0000","last_active":"2023-09-28T00:15:29.394391+0000","last_peered":"2023-09-28T00:15:29.394391+0000","last_clean":"2023-09-28T00:15:29.394391+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:15:29.394391+0000","last_undegraded":"2023-09-28T00:15:29.394391+0000","last_fullsized":"2023-09-28T00:15:29.394391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402306+0000","last_change":"2023-09-28T00:15:28.986069+0000","last_active":"2023-09-28T00:15:29.402306+0000","last_peered":"2023-09-28T00:15:29.402306+0000","last_clean":"2023-09-28T00:15:29.402306+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:15:29.402306+0000","last_undegraded":"2023-09-28T00:15:29.402306+0000","last_fullsized":"2023-09-28T00:15:29.402306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397756+0000","last_change":"2023-09-28T00:15:29.393182+0000","last_active":"2023-09-28T00:15:29.397756+0000","last_peered":"2023-09-28T00:15:29.397756+0000","last_clean":"2023-09-28T00:15:29.397756+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:15:29.397756+0000","last_undegraded":"2023-09-28T00:15:29.397756+0000","last_fullsized":"2023-09-28T00:15:29.397756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385144+0000","last_change":"2023-09-28T00:15:28.985291+0000","last_active":"2023-09-28T00:15:29.385144+0000","last_peered":"2023-09-28T00:15:29.385144+0000","last_clean":"2023-09-28T00:15:29.385144+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:15:29.385144+0000","last_undegraded":"2023-09-28T00:15:29.385144+0000","last_fullsized":"2023-09-28T00:15:29.385144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404083+0000","last_change":"2023-09-28T00:15:29.400083+0000","last_active":"2023-09-28T00:15:29.404083+0000","last_peered":"2023-09-28T00:15:29.404083+0000","last_clean":"2023-09-28T00:15:29.404083+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:15:29.404083+0000","last_undegraded":"2023-09-28T00:15:29.404083+0000","last_fullsized":"2023-09-28T00:15:29.404083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385946+0000","last_change":"2023-09-28T00:15:28.980715+0000","last_active":"2023-09-28T00:15:29.385946+0000","last_peered":"2023-09-28T00:15:29.385946+0000","last_clean":"2023-09-28T00:15:29.385946+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:15:29.385946+0000","last_undegraded":"2023-09-28T00:15:29.385946+0000","last_fullsized":"2023-09-28T00:15:29.385946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400065+0000","last_change":"2023-09-28T00:15:29.397875+0000","last_active":"2023-09-28T00:15:29.400065+0000","last_peered":"2023-09-28T00:15:29.400065+0000","last_clean":"2023-09-28T00:15:29.400065+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:15:29.400065+0000","last_undegraded":"2023-09-28T00:15:29.400065+0000","last_fullsized":"2023-09-28T00:15:29.400065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:35:06.112174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375411+0000","last_change":"2023-09-28T00:15:28.986410+0000","last_active":"2023-09-28T00:15:29.375411+0000","last_peered":"2023-09-28T00:15:29.375411+0000","last_clean":"2023-09-28T00:15:29.375411+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:15:29.375411+0000","last_undegraded":"2023-09-28T00:15:29.375411+0000","last_fullsized":"2023-09-28T00:15:29.375411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398187+0000","last_change":"2023-09-28T00:15:29.392748+0000","last_active":"2023-09-28T00:15:29.398187+0000","last_peered":"2023-09-28T00:15:29.398187+0000","last_clean":"2023-09-28T00:15:29.398187+0000","last_became_active":"2023-09-28T00:15:29.392336+0000","last_became_peered":"2023-09-28T00:15:29.392336+0000","last_unstale":"2023-09-28T00:15:29.398187+0000","last_undegraded":"2023-09-28T00:15:29.398187+0000","last_fullsized":"2023-09-28T00:15:29.398187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380356+0000","last_change":"2023-09-28T00:15:24.193273+0000","last_active":"2023-09-28T00:15:29.380356+0000","last_peered":"2023-09-28T00:15:29.380356+0000","last_clean":"2023-09-28T00:15:29.380356+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:15:29.380356+0000","last_undegraded":"2023-09-28T00:15:29.380356+0000","last_fullsized":"2023-09-28T00:15:29.380356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:55:44.401134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379326+0000","last_change":"2023-09-28T00:15:28.986194+0000","last_active":"2023-09-28T00:15:29.379326+0000","last_peered":"2023-09-28T00:15:29.379326+0000","last_clean":"2023-09-28T00:15:29.379326+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:15:29.379326+0000","last_undegraded":"2023-09-28T00:15:29.379326+0000","last_fullsized":"2023-09-28T00:15:29.379326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390889+0000","last_change":"2023-09-28T00:15:29.388604+0000","last_active":"2023-09-28T00:15:29.390889+0000","last_peered":"2023-09-28T00:15:29.390889+0000","last_clean":"2023-09-28T00:15:29.390889+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:15:29.390889+0000","last_undegraded":"2023-09-28T00:15:29.390889+0000","last_fullsized":"2023-09-28T00:15:29.390889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378226+0000","last_change":"2023-09-28T00:15:23.950475+0000","last_active":"2023-09-28T00:15:29.378226+0000","last_peered":"2023-09-28T00:15:29.378226+0000","last_clean":"2023-09-28T00:15:29.378226+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:15:29.378226+0000","last_undegraded":"2023-09-28T00:15:29.378226+0000","last_fullsized":"2023-09-28T00:15:29.378226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386282+0000","last_change":"2023-09-28T00:15:28.984604+0000","last_active":"2023-09-28T00:15:29.386282+0000","last_peered":"2023-09-28T00:15:29.386282+0000","last_clean":"2023-09-28T00:15:29.386282+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:15:29.386282+0000","last_undegraded":"2023-09-28T00:15:29.386282+0000","last_fullsized":"2023-09-28T00:15:29.386282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398171+0000","last_change":"2023-09-28T00:15:29.392616+0000","last_active":"2023-09-28T00:15:29.398171+0000","last_peered":"2023-09-28T00:15:29.398171+0000","last_clean":"2023-09-28T00:15:29.398171+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:15:29.398171+0000","last_undegraded":"2023-09-28T00:15:29.398171+0000","last_fullsized":"2023-09-28T00:15:29.398171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:20:56.060002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379003+0000","last_change":"2023-09-28T00:15:24.193731+0000","last_active":"2023-09-28T00:15:29.379003+0000","last_peered":"2023-09-28T00:15:29.379003+0000","last_clean":"2023-09-28T00:15:29.379003+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:15:29.379003+0000","last_undegraded":"2023-09-28T00:15:29.379003+0000","last_fullsized":"2023-09-28T00:15:29.379003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:10:07.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378537+0000","last_change":"2023-09-28T00:15:28.980294+0000","last_active":"2023-09-28T00:15:29.378537+0000","last_peered":"2023-09-28T00:15:29.378537+0000","last_clean":"2023-09-28T00:15:29.378537+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:15:29.378537+0000","last_undegraded":"2023-09-28T00:15:29.378537+0000","last_fullsized":"2023-09-28T00:15:29.378537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390883+0000","last_change":"2023-09-28T00:15:29.388008+0000","last_active":"2023-09-28T00:15:29.390883+0000","last_peered":"2023-09-28T00:15:29.390883+0000","last_clean":"2023-09-28T00:15:29.390883+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:15:29.390883+0000","last_undegraded":"2023-09-28T00:15:29.390883+0000","last_fullsized":"2023-09-28T00:15:29.390883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.377855+0000","last_change":"2023-09-28T00:15:23.950457+0000","last_active":"2023-09-28T00:15:29.377855+0000","last_peered":"2023-09-28T00:15:29.377855+0000","last_clean":"2023-09-28T00:15:29.377855+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:15:29.377855+0000","last_undegraded":"2023-09-28T00:15:29.377855+0000","last_fullsized":"2023-09-28T00:15:29.377855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380256+0000","last_change":"2023-09-28T00:15:16.995081+0000","last_active":"2023-09-28T00:15:29.380256+0000","last_peered":"2023-09-28T00:15:29.380256+0000","last_clean":"2023-09-28T00:15:29.380256+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:15:29.380256+0000","last_undegraded":"2023-09-28T00:15:29.380256+0000","last_fullsized":"2023-09-28T00:15:29.380256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_clean_scrub_stamp":"2023-09-28T00:15:15.867916+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:37:49.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375538+0000","last_change":"2023-09-28T00:15:28.985016+0000","last_active":"2023-09-28T00:15:29.375538+0000","last_peered":"2023-09-28T00:15:29.375538+0000","last_clean":"2023-09-28T00:15:29.375538+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:15:29.375538+0000","last_undegraded":"2023-09-28T00:15:29.375538+0000","last_fullsized":"2023-09-28T00:15:29.375538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403095+0000","last_change":"2023-09-28T00:15:29.401863+0000","last_active":"2023-09-28T00:15:29.403095+0000","last_peered":"2023-09-28T00:15:29.403095+0000","last_clean":"2023-09-28T00:15:29.403095+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:15:29.403095+0000","last_undegraded":"2023-09-28T00:15:29.403095+0000","last_fullsized":"2023-09-28T00:15:29.403095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:17.400054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380675+0000","last_change":"2023-09-28T00:15:23.946737+0000","last_active":"2023-09-28T00:15:29.380675+0000","last_peered":"2023-09-28T00:15:29.380675+0000","last_clean":"2023-09-28T00:15:29.380675+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:15:29.380675+0000","last_undegraded":"2023-09-28T00:15:29.380675+0000","last_fullsized":"2023-09-28T00:15:29.380675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386570+0000","last_change":"2023-09-28T00:15:28.986464+0000","last_active":"2023-09-28T00:15:29.386570+0000","last_peered":"2023-09-28T00:15:29.386570+0000","last_clean":"2023-09-28T00:15:29.386570+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:15:29.386570+0000","last_undegraded":"2023-09-28T00:15:29.386570+0000","last_fullsized":"2023-09-28T00:15:29.386570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398876+0000","last_change":"2023-09-28T00:15:29.390313+0000","last_active":"2023-09-28T00:15:29.398876+0000","last_peered":"2023-09-28T00:15:29.398876+0000","last_clean":"2023-09-28T00:15:29.398876+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:15:29.398876+0000","last_undegraded":"2023-09-28T00:15:29.398876+0000","last_fullsized":"2023-09-28T00:15:29.398876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379277+0000","last_change":"2023-09-28T00:15:24.193260+0000","last_active":"2023-09-28T00:15:29.379277+0000","last_peered":"2023-09-28T00:15:29.379277+0000","last_clean":"2023-09-28T00:15:29.379277+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:15:29.379277+0000","last_undegraded":"2023-09-28T00:15:29.379277+0000","last_fullsized":"2023-09-28T00:15:29.379277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380464+0000","last_change":"2023-09-28T00:15:28.979725+0000","last_active":"2023-09-28T00:15:29.380464+0000","last_peered":"2023-09-28T00:15:29.380464+0000","last_clean":"2023-09-28T00:15:29.380464+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:15:29.380464+0000","last_undegraded":"2023-09-28T00:15:29.380464+0000","last_fullsized":"2023-09-28T00:15:29.380464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402412+0000","last_change":"2023-09-28T00:15:29.398984+0000","last_active":"2023-09-28T00:15:29.402412+0000","last_peered":"2023-09-28T00:15:29.402412+0000","last_clean":"2023-09-28T00:15:29.402412+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:15:29.402412+0000","last_undegraded":"2023-09-28T00:15:29.402412+0000","last_fullsized":"2023-09-28T00:15:29.402412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395338+0000","last_change":"2023-09-28T00:15:28.989236+0000","last_active":"2023-09-28T00:15:29.395338+0000","last_peered":"2023-09-28T00:15:29.395338+0000","last_clean":"2023-09-28T00:15:29.395338+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:15:29.395338+0000","last_undegraded":"2023-09-28T00:15:29.395338+0000","last_fullsized":"2023-09-28T00:15:29.395338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380630+0000","last_change":"2023-09-28T00:15:23.949425+0000","last_active":"2023-09-28T00:15:29.380630+0000","last_peered":"2023-09-28T00:15:29.380630+0000","last_clean":"2023-09-28T00:15:29.380630+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:15:29.380630+0000","last_undegraded":"2023-09-28T00:15:29.380630+0000","last_fullsized":"2023-09-28T00:15:29.380630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:59:04.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391469+0000","last_change":"2023-09-28T00:15:29.386508+0000","last_active":"2023-09-28T00:15:29.391469+0000","last_peered":"2023-09-28T00:15:29.391469+0000","last_clean":"2023-09-28T00:15:29.391469+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:15:29.391469+0000","last_undegraded":"2023-09-28T00:15:29.391469+0000","last_fullsized":"2023-09-28T00:15:29.391469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385234+0000","last_change":"2023-09-28T00:15:23.949692+0000","last_active":"2023-09-28T00:15:29.385234+0000","last_peered":"2023-09-28T00:15:29.385234+0000","last_clean":"2023-09-28T00:15:29.385234+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:15:29.385234+0000","last_undegraded":"2023-09-28T00:15:29.385234+0000","last_fullsized":"2023-09-28T00:15:29.385234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:48:11.275095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778335+0000","last_change":"2023-09-28T00:15:28.988077+0000","last_active":"2023-09-28T00:15:30.778335+0000","last_peered":"2023-09-28T00:15:30.778335+0000","last_clean":"2023-09-28T00:15:30.778335+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:15:30.778335+0000","last_undegraded":"2023-09-28T00:15:30.778335+0000","last_fullsized":"2023-09-28T00:15:30.778335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399373+0000","last_change":"2023-09-28T00:15:29.398170+0000","last_active":"2023-09-28T00:15:29.399373+0000","last_peered":"2023-09-28T00:15:29.399373+0000","last_clean":"2023-09-28T00:15:29.399373+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:15:29.399373+0000","last_undegraded":"2023-09-28T00:15:29.399373+0000","last_fullsized":"2023-09-28T00:15:29.399373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:30:23.382889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402252+0000","last_change":"2023-09-28T00:15:28.987224+0000","last_active":"2023-09-28T00:15:29.402252+0000","last_peered":"2023-09-28T00:15:29.402252+0000","last_clean":"2023-09-28T00:15:29.402252+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:15:29.402252+0000","last_undegraded":"2023-09-28T00:15:29.402252+0000","last_fullsized":"2023-09-28T00:15:29.402252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391371+0000","last_change":"2023-09-28T00:15:29.383759+0000","last_active":"2023-09-28T00:15:29.391371+0000","last_peered":"2023-09-28T00:15:29.391371+0000","last_clean":"2023-09-28T00:15:29.391371+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:15:29.391371+0000","last_undegraded":"2023-09-28T00:15:29.391371+0000","last_fullsized":"2023-09-28T00:15:29.391371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:06.286162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402275+0000","last_change":"2023-09-28T00:15:28.987633+0000","last_active":"2023-09-28T00:15:29.402275+0000","last_peered":"2023-09-28T00:15:29.402275+0000","last_clean":"2023-09-28T00:15:29.402275+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:15:29.402275+0000","last_undegraded":"2023-09-28T00:15:29.402275+0000","last_fullsized":"2023-09-28T00:15:29.402275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398131+0000","last_change":"2023-09-28T00:15:29.392897+0000","last_active":"2023-09-28T00:15:29.398131+0000","last_peered":"2023-09-28T00:15:29.398131+0000","last_clean":"2023-09-28T00:15:29.398131+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:15:29.398131+0000","last_undegraded":"2023-09-28T00:15:29.398131+0000","last_fullsized":"2023-09-28T00:15:29.398131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403684+0000","last_change":"2023-09-28T00:15:28.987962+0000","last_active":"2023-09-28T00:15:29.403684+0000","last_peered":"2023-09-28T00:15:29.403684+0000","last_clean":"2023-09-28T00:15:29.403684+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:15:29.403684+0000","last_undegraded":"2023-09-28T00:15:29.403684+0000","last_fullsized":"2023-09-28T00:15:29.403684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399076+0000","last_change":"2023-09-28T00:15:29.394598+0000","last_active":"2023-09-28T00:15:29.399076+0000","last_peered":"2023-09-28T00:15:29.399076+0000","last_clean":"2023-09-28T00:15:29.399076+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:15:29.399076+0000","last_undegraded":"2023-09-28T00:15:29.399076+0000","last_fullsized":"2023-09-28T00:15:29.399076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396285+0000","last_change":"2023-09-28T00:15:28.983686+0000","last_active":"2023-09-28T00:15:29.396285+0000","last_peered":"2023-09-28T00:15:29.396285+0000","last_clean":"2023-09-28T00:15:29.396285+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:15:29.396285+0000","last_undegraded":"2023-09-28T00:15:29.396285+0000","last_fullsized":"2023-09-28T00:15:29.396285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391633+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:15:29.391633+0000","last_peered":"2023-09-28T00:15:29.391633+0000","last_clean":"2023-09-28T00:15:29.391633+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:15:29.391633+0000","last_undegraded":"2023-09-28T00:15:29.391633+0000","last_fullsized":"2023-09-28T00:15:29.391633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402519+0000","last_change":"2023-09-28T00:15:28.985280+0000","last_active":"2023-09-28T00:15:29.402519+0000","last_peered":"2023-09-28T00:15:29.402519+0000","last_clean":"2023-09-28T00:15:29.402519+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:15:29.402519+0000","last_undegraded":"2023-09-28T00:15:29.402519+0000","last_fullsized":"2023-09-28T00:15:29.402519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400030+0000","last_change":"2023-09-28T00:15:29.398360+0000","last_active":"2023-09-28T00:15:29.400030+0000","last_peered":"2023-09-28T00:15:29.400030+0000","last_clean":"2023-09-28T00:15:29.400030+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:15:29.400030+0000","last_undegraded":"2023-09-28T00:15:29.400030+0000","last_fullsized":"2023-09-28T00:15:29.400030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:58:13.878285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400854+0000","last_change":"2023-09-28T00:15:29.395080+0000","last_active":"2023-09-28T00:15:29.400854+0000","last_peered":"2023-09-28T00:15:29.400854+0000","last_clean":"2023-09-28T00:15:29.400854+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:15:29.400854+0000","last_undegraded":"2023-09-28T00:15:29.400854+0000","last_fullsized":"2023-09-28T00:15:29.400854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:39.792299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391615+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:15:29.391615+0000","last_peered":"2023-09-28T00:15:29.391615+0000","last_clean":"2023-09-28T00:15:29.391615+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:15:29.391615+0000","last_undegraded":"2023-09-28T00:15:29.391615+0000","last_fullsized":"2023-09-28T00:15:29.391615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403283+0000","last_change":"2023-09-28T00:15:29.399203+0000","last_active":"2023-09-28T00:15:29.403283+0000","last_peered":"2023-09-28T00:15:29.403283+0000","last_clean":"2023-09-28T00:15:29.403283+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:15:29.403283+0000","last_undegraded":"2023-09-28T00:15:29.403283+0000","last_fullsized":"2023-09-28T00:15:29.403283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:47:48.079491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391392+0000","last_change":"2023-09-28T00:15:29.388644+0000","last_active":"2023-09-28T00:15:29.391392+0000","last_peered":"2023-09-28T00:15:29.391392+0000","last_clean":"2023-09-28T00:15:29.391392+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:15:29.391392+0000","last_undegraded":"2023-09-28T00:15:29.391392+0000","last_fullsized":"2023-09-28T00:15:29.391392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390790+0000","last_change":"2023-09-28T00:15:29.388432+0000","last_active":"2023-09-28T00:15:29.390790+0000","last_peered":"2023-09-28T00:15:29.390790+0000","last_clean":"2023-09-28T00:15:29.390790+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:15:29.390790+0000","last_undegraded":"2023-09-28T00:15:29.390790+0000","last_fullsized":"2023-09-28T00:15:29.390790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8004,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363836,"statfs":{"total":96636764160,"available":96628568064,"internally_reserved":0,"allocated":258048,"data_stored":93762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9092,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362748,"statfs":{"total":96636764160,"available":96627453952,"internally_reserved":0,"allocated":847872,"data_stored":684060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.901}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.548}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9116,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362724,"statfs":{"total":96636764160,"available":96627429376,"internally_reserved":0,"allocated":872448,"data_stored":685258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7932,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363908,"statfs":{"total":96636764160,"available":96628641792,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":93228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":270336,"data_stored":94730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:15:36.404 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:15:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.557+0000 7f6ffdd6b700 1 Processor -- start 2023-09-28T00:15:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.557+0000 7f6ffdd6b700 1 -- start start 2023-09-28T00:15:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffdd6b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ff80cbda0 0x7f6ff8067630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffdd6b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6ff8067b70 0x7f6ff815c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffdd6b700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff80af040 con 0x7f6ff80cc170 2023-09-28T00:15:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffdd6b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff80afd70 con 0x7f6ff80cbda0 2023-09-28T00:15:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffdd6b700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff8068080 con 0x7f6ff8067b70 2023-09-28T00:15:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffcd69700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ff80cbda0 0x7f6ff8067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffcd69700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ff80cbda0 0x7f6ff8067630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46704/0 (socket says 172.21.15.26:46704) 2023-09-28T00:15:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffcd69700 1 -- 172.21.15.26:0/1024567950 learned_addr learned my addr 172.21.15.26:0/1024567950 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ff7fff700 1 --2- 172.21.15.26:0/1024567950 >> v2:172.21.15.190:3300/0 conn(0x7f6ff8067b70 0x7f6ff815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffcd69700 1 -- 172.21.15.26:0/1024567950 >> v2:172.21.15.190:3300/0 conn(0x7f6ff8067b70 msgr2=0x7f6ff815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffcd69700 1 --2- 172.21.15.26:0/1024567950 >> v2:172.21.15.190:3300/0 conn(0x7f6ff8067b70 0x7f6ff815c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffcd69700 1 -- 172.21.15.26:0/1024567950 >> v1:172.21.15.190:6789/0 conn(0x7f6ff80cc170 legacy=0x7f6ff815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffcd69700 1 -- 172.21.15.26:0/1024567950 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80af290 con 0x7f6ff80cbda0 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.558+0000 7f6ffcd69700 1 --2- 172.21.15.26:0/1024567950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 0x7f6ff8067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8068360 tx=0x7f6ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4697069bb00c12c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ff77fe700 1 -- 172.21.15.26:0/1024567950 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000b820 con 0x7f6ff80cbda0 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ff77fe700 1 -- 172.21.15.26:0/1024567950 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff000b980 con 0x7f6ff80cbda0 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ff77fe700 1 -- 172.21.15.26:0/1024567950 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff000bd20 con 0x7f6ff80cbda0 2023-09-28T00:15:36.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/1024567950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 msgr2=0x7f6ff8067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ffdd6b700 1 --2- 172.21.15.26:0/1024567950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 0x7f6ff8067630 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8068360 tx=0x7f6ff0009250 comp rx=0 tx=0).stop 2023-09-28T00:15:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/1024567950 shutdown_connections 2023-09-28T00:15:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ffdd6b700 1 --2- 172.21.15.26:0/1024567950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 0x7f6ff8067630 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ffdd6b700 1 --2- 172.21.15.26:0/1024567950 >> v2:172.21.15.190:3300/0 conn(0x7f6ff8067b70 0x7f6ff815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/1024567950 >> 172.21.15.26:0/1024567950 conn(0x7f6ff80d0f70 msgr2=0x7f6ff80ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/1024567950 shutdown_connections 2023-09-28T00:15:36.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.559+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/1024567950 wait complete. 2023-09-28T00:15:36.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.560+0000 7f6ffdd6b700 1 Processor -- start 2023-09-28T00:15:36.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.560+0000 7f6ffdd6b700 1 -- start start 2023-09-28T00:15:36.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ffdd6b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff8067b70 0x7f6ff81490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ffdd6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 0x7f6ff80b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ffdd6b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff80cc170 0x7f6ff815e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ffdd6b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80b3d00 con 0x7f6ff80cbda0 2023-09-28T00:15:36.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ffdd6b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff8149610 con 0x7f6ff80cc170 2023-09-28T00:15:36.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ffdd6b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80b33d0 con 0x7f6ff8067b70 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ff7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 0x7f6ff80b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ff7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 0x7f6ff80b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46710/0 (socket says 172.21.15.26:46710) 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ff7fff700 1 -- 172.21.15.26:0/889920389 learned_addr learned my addr 172.21.15.26:0/889920389 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.561+0000 7f6ffd56a700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff80cc170 0x7f6ff815e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ff7fff700 1 -- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff8067b70 msgr2=0x7f6ff81490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ff7fff700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff8067b70 0x7f6ff81490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ff7fff700 1 -- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff80cc170 msgr2=0x7f6ff815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ff7fff700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff80cc170 0x7f6ff815e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ff7fff700 1 -- 172.21.15.26:0/889920389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff00094f0 con 0x7f6ff80cbda0 2023-09-28T00:15:36.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ffd56a700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff80cc170 0x7f6ff815e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ff7fff700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 0x7f6ff80b4d70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800cde0 tx=0x7f6fe80077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ff4ff9700 1 -- 172.21.15.26:0/889920389 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe800ab90 con 0x7f6ff80cbda0 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ff4ff9700 1 -- 172.21.15.26:0/889920389 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe800acf0 con 0x7f6ff80cbda0 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff80b36b0 con 0x7f6ff80cbda0 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ff4ff9700 1 -- 172.21.15.26:0/889920389 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8017660 con 0x7f6ff80cbda0 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.562+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff80b5600 con 0x7f6ff80cbda0 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.563+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff804c3c0 con 0x7f6ff80cbda0 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.563+0000 7f6ff4ff9700 1 -- 172.21.15.26:0/889920389 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6fe8003020 con 0x7f6ff80cbda0 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.564+0000 7f6ff4ff9700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6fd8067330 0x7f6fd80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.564+0000 7f6ff4ff9700 1 -- 172.21.15.26:0/889920389 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6fe8013070 con 0x7f6ff80cbda0 2023-09-28T00:15:36.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.564+0000 7f6ffcd69700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6fd8067330 0x7f6fd80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.564+0000 7f6ffcd69700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6fd8067330 0x7f6fd80697e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8068360 tx=0x7f6ff0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:36.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.568+0000 7f6ff4ff9700 1 -- 172.21.15.26:0/889920389 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f6fe8052100 con 0x7f6ff80cbda0 2023-09-28T00:15:36.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.757+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ff80b3e40 con 0x7f6fd8067330 2023-09-28T00:15:36.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.765+0000 7f6ff4ff9700 1 -- 172.21.15.26:0/889920389 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284640 (secure 0 0 0) 0x7f6ff80b3e40 con 0x7f6fd8067330 2023-09-28T00:15:36.769 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.768+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6fd8067330 msgr2=0x7f6fd80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6fd8067330 0x7f6fd80697e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8068360 tx=0x7f6ff0016000 comp rx=0 tx=0).stop 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 msgr2=0x7f6ff80b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 0x7f6ff80b4d70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6fe800cde0 tx=0x7f6fe80077e0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 shutdown_connections 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6fd8067330 0x7f6fd80697e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ff8067b70 0x7f6ff81490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ff80cc170 0x7f6ff815e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 --2- 172.21.15.26:0/889920389 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ff80cbda0 0x7f6ff80b4d70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 >> 172.21.15.26:0/889920389 conn(0x7f6ff80d0f70 msgr2=0x7f6ff80c52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:36.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 shutdown_connections 2023-09-28T00:15:36.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.769+0000 7f6ffdd6b700 1 -- 172.21.15.26:0/889920389 wait complete. 2023-09-28T00:15:36.773 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:15:36.782 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-09-28T00:15:35.668904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66344,"kb_used_data":3176,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908376,"statfs":{"total":773094113280,"available":773026177024,"internally_reserved":0,"allocated":3252224,"data_stored":1930452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.701738"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393167+0000","last_change":"2023-09-28T00:15:29.392083+0000","last_active":"2023-09-28T00:15:29.393167+0000","last_peered":"2023-09-28T00:15:29.393167+0000","last_clean":"2023-09-28T00:15:29.393167+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:15:29.393167+0000","last_undegraded":"2023-09-28T00:15:29.393167+0000","last_fullsized":"2023-09-28T00:15:29.393167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:53.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391806+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:15:29.391806+0000","last_peered":"2023-09-28T00:15:29.391806+0000","last_clean":"2023-09-28T00:15:29.391806+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:15:29.391806+0000","last_undegraded":"2023-09-28T00:15:29.391806+0000","last_fullsized":"2023-09-28T00:15:29.391806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404174+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:15:29.404174+0000","last_peered":"2023-09-28T00:15:29.404174+0000","last_clean":"2023-09-28T00:15:29.404174+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:15:29.404174+0000","last_undegraded":"2023-09-28T00:15:29.404174+0000","last_fullsized":"2023-09-28T00:15:29.404174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:31:15.779086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394940+0000","last_change":"2023-09-28T00:15:29.387338+0000","last_active":"2023-09-28T00:15:29.394940+0000","last_peered":"2023-09-28T00:15:29.394940+0000","last_clean":"2023-09-28T00:15:29.394940+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:15:29.394940+0000","last_undegraded":"2023-09-28T00:15:29.394940+0000","last_fullsized":"2023-09-28T00:15:29.394940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:11.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402390+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:15:29.402390+0000","last_peered":"2023-09-28T00:15:29.402390+0000","last_clean":"2023-09-28T00:15:29.402390+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:15:29.402390+0000","last_undegraded":"2023-09-28T00:15:29.402390+0000","last_fullsized":"2023-09-28T00:15:29.402390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403262+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:15:29.403262+0000","last_peered":"2023-09-28T00:15:29.403262+0000","last_clean":"2023-09-28T00:15:29.403262+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:15:29.403262+0000","last_undegraded":"2023-09-28T00:15:29.403262+0000","last_fullsized":"2023-09-28T00:15:29.403262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:10.975572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390765+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:15:29.390765+0000","last_peered":"2023-09-28T00:15:29.390765+0000","last_clean":"2023-09-28T00:15:29.390765+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:15:29.390765+0000","last_undegraded":"2023-09-28T00:15:29.390765+0000","last_fullsized":"2023-09-28T00:15:29.390765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399845+0000","last_change":"2023-09-28T00:15:29.398742+0000","last_active":"2023-09-28T00:15:29.399845+0000","last_peered":"2023-09-28T00:15:29.399845+0000","last_clean":"2023-09-28T00:15:29.399845+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:15:29.399845+0000","last_undegraded":"2023-09-28T00:15:29.399845+0000","last_fullsized":"2023-09-28T00:15:29.399845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402654+0000","last_change":"2023-09-28T00:15:29.401666+0000","last_active":"2023-09-28T00:15:29.402654+0000","last_peered":"2023-09-28T00:15:29.402654+0000","last_clean":"2023-09-28T00:15:29.402654+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:15:29.402654+0000","last_undegraded":"2023-09-28T00:15:29.402654+0000","last_fullsized":"2023-09-28T00:15:29.402654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394457+0000","last_change":"2023-09-28T00:15:29.388253+0000","last_active":"2023-09-28T00:15:29.394457+0000","last_peered":"2023-09-28T00:15:29.394457+0000","last_clean":"2023-09-28T00:15:29.394457+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:15:29.394457+0000","last_undegraded":"2023-09-28T00:15:29.394457+0000","last_fullsized":"2023-09-28T00:15:29.394457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397977+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:15:29.397977+0000","last_peered":"2023-09-28T00:15:29.397977+0000","last_clean":"2023-09-28T00:15:29.397977+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:15:29.397977+0000","last_undegraded":"2023-09-28T00:15:29.397977+0000","last_fullsized":"2023-09-28T00:15:29.397977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400172+0000","last_change":"2023-09-28T00:15:29.399521+0000","last_active":"2023-09-28T00:15:29.400172+0000","last_peered":"2023-09-28T00:15:29.400172+0000","last_clean":"2023-09-28T00:15:29.400172+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:15:29.400172+0000","last_undegraded":"2023-09-28T00:15:29.400172+0000","last_fullsized":"2023-09-28T00:15:29.400172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:38.462117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393250+0000","last_change":"2023-09-28T00:15:29.392028+0000","last_active":"2023-09-28T00:15:29.393250+0000","last_peered":"2023-09-28T00:15:29.393250+0000","last_clean":"2023-09-28T00:15:29.393250+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:15:29.393250+0000","last_undegraded":"2023-09-28T00:15:29.393250+0000","last_fullsized":"2023-09-28T00:15:29.393250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397374+0000","last_change":"2023-09-28T00:15:29.394175+0000","last_active":"2023-09-28T00:15:29.397374+0000","last_peered":"2023-09-28T00:15:29.397374+0000","last_clean":"2023-09-28T00:15:29.397374+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:15:29.397374+0000","last_undegraded":"2023-09-28T00:15:29.397374+0000","last_fullsized":"2023-09-28T00:15:29.397374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394506+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:15:29.394506+0000","last_peered":"2023-09-28T00:15:29.394506+0000","last_clean":"2023-09-28T00:15:29.394506+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:15:29.394506+0000","last_undegraded":"2023-09-28T00:15:29.394506+0000","last_fullsized":"2023-09-28T00:15:29.394506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398296+0000","last_change":"2023-09-28T00:15:29.397273+0000","last_active":"2023-09-28T00:15:29.398296+0000","last_peered":"2023-09-28T00:15:29.398296+0000","last_clean":"2023-09-28T00:15:29.398296+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:15:29.398296+0000","last_undegraded":"2023-09-28T00:15:29.398296+0000","last_fullsized":"2023-09-28T00:15:29.398296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402636+0000","last_change":"2023-09-28T00:15:29.401695+0000","last_active":"2023-09-28T00:15:29.402636+0000","last_peered":"2023-09-28T00:15:29.402636+0000","last_clean":"2023-09-28T00:15:29.402636+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:15:29.402636+0000","last_undegraded":"2023-09-28T00:15:29.402636+0000","last_fullsized":"2023-09-28T00:15:29.402636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400097+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:15:29.400097+0000","last_peered":"2023-09-28T00:15:29.400097+0000","last_clean":"2023-09-28T00:15:29.400097+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:15:29.400097+0000","last_undegraded":"2023-09-28T00:15:29.400097+0000","last_fullsized":"2023-09-28T00:15:29.400097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391545+0000","last_change":"2023-09-28T00:15:29.386237+0000","last_active":"2023-09-28T00:15:29.391545+0000","last_peered":"2023-09-28T00:15:29.391545+0000","last_clean":"2023-09-28T00:15:29.391545+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:15:29.391545+0000","last_undegraded":"2023-09-28T00:15:29.391545+0000","last_fullsized":"2023-09-28T00:15:29.391545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403381+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:15:29.403381+0000","last_peered":"2023-09-28T00:15:29.403381+0000","last_clean":"2023-09-28T00:15:29.403381+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:15:29.403381+0000","last_undegraded":"2023-09-28T00:15:29.403381+0000","last_fullsized":"2023-09-28T00:15:29.403381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:49:33.646923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394054+0000","last_change":"2023-09-28T00:15:29.392231+0000","last_active":"2023-09-28T00:15:29.394054+0000","last_peered":"2023-09-28T00:15:29.394054+0000","last_clean":"2023-09-28T00:15:29.394054+0000","last_became_active":"2023-09-28T00:15:29.391855+0000","last_became_peered":"2023-09-28T00:15:29.391855+0000","last_unstale":"2023-09-28T00:15:29.394054+0000","last_undegraded":"2023-09-28T00:15:29.394054+0000","last_fullsized":"2023-09-28T00:15:29.394054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.401694+0000","last_change":"2023-09-28T00:15:29.394242+0000","last_active":"2023-09-28T00:15:29.401694+0000","last_peered":"2023-09-28T00:15:29.401694+0000","last_clean":"2023-09-28T00:15:29.401694+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:15:29.401694+0000","last_undegraded":"2023-09-28T00:15:29.401694+0000","last_fullsized":"2023-09-28T00:15:29.401694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391666+0000","last_change":"2023-09-28T00:15:29.389082+0000","last_active":"2023-09-28T00:15:29.391666+0000","last_peered":"2023-09-28T00:15:29.391666+0000","last_clean":"2023-09-28T00:15:29.391666+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:15:29.391666+0000","last_undegraded":"2023-09-28T00:15:29.391666+0000","last_fullsized":"2023-09-28T00:15:29.391666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394025+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:15:29.394025+0000","last_peered":"2023-09-28T00:15:29.394025+0000","last_clean":"2023-09-28T00:15:29.394025+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:15:29.394025+0000","last_undegraded":"2023-09-28T00:15:29.394025+0000","last_fullsized":"2023-09-28T00:15:29.394025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398162+0000","last_change":"2023-09-28T00:15:29.392586+0000","last_active":"2023-09-28T00:15:29.398162+0000","last_peered":"2023-09-28T00:15:29.398162+0000","last_clean":"2023-09-28T00:15:29.398162+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:15:29.398162+0000","last_undegraded":"2023-09-28T00:15:29.398162+0000","last_fullsized":"2023-09-28T00:15:29.398162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:16:11.243076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386766+0000","last_change":"2023-09-28T00:15:29.384837+0000","last_active":"2023-09-28T00:15:29.386766+0000","last_peered":"2023-09-28T00:15:29.386766+0000","last_clean":"2023-09-28T00:15:29.386766+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:15:29.386766+0000","last_undegraded":"2023-09-28T00:15:29.386766+0000","last_fullsized":"2023-09-28T00:15:29.386766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:49:32.973094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398577+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:15:29.398577+0000","last_peered":"2023-09-28T00:15:29.398577+0000","last_clean":"2023-09-28T00:15:29.398577+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:15:29.398577+0000","last_undegraded":"2023-09-28T00:15:29.398577+0000","last_fullsized":"2023-09-28T00:15:29.398577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399602+0000","last_change":"2023-09-28T00:15:28.982899+0000","last_active":"2023-09-28T00:15:29.399602+0000","last_peered":"2023-09-28T00:15:29.399602+0000","last_clean":"2023-09-28T00:15:29.399602+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:15:29.399602+0000","last_undegraded":"2023-09-28T00:15:29.399602+0000","last_fullsized":"2023-09-28T00:15:29.399602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390553+0000","last_change":"2023-09-28T00:15:29.383398+0000","last_active":"2023-09-28T00:15:29.390553+0000","last_peered":"2023-09-28T00:15:29.390553+0000","last_clean":"2023-09-28T00:15:29.390553+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:15:29.390553+0000","last_undegraded":"2023-09-28T00:15:29.390553+0000","last_fullsized":"2023-09-28T00:15:29.390553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380346+0000","last_change":"2023-09-28T00:15:28.984308+0000","last_active":"2023-09-28T00:15:29.380346+0000","last_peered":"2023-09-28T00:15:29.380346+0000","last_clean":"2023-09-28T00:15:29.380346+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:15:29.380346+0000","last_undegraded":"2023-09-28T00:15:29.380346+0000","last_fullsized":"2023-09-28T00:15:29.380346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402446+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:15:29.402446+0000","last_peered":"2023-09-28T00:15:29.402446+0000","last_clean":"2023-09-28T00:15:29.402446+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:15:29.402446+0000","last_undegraded":"2023-09-28T00:15:29.402446+0000","last_fullsized":"2023-09-28T00:15:29.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375855+0000","last_change":"2023-09-28T00:15:28.986600+0000","last_active":"2023-09-28T00:15:29.375855+0000","last_peered":"2023-09-28T00:15:29.375855+0000","last_clean":"2023-09-28T00:15:29.375855+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:15:29.375855+0000","last_undegraded":"2023-09-28T00:15:29.375855+0000","last_fullsized":"2023-09-28T00:15:29.375855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397007+0000","last_change":"2023-09-28T00:15:29.391209+0000","last_active":"2023-09-28T00:15:29.397007+0000","last_peered":"2023-09-28T00:15:29.397007+0000","last_clean":"2023-09-28T00:15:29.397007+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:15:29.397007+0000","last_undegraded":"2023-09-28T00:15:29.397007+0000","last_fullsized":"2023-09-28T00:15:29.397007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394579+0000","last_change":"2023-09-28T00:15:28.990492+0000","last_active":"2023-09-28T00:15:29.394579+0000","last_peered":"2023-09-28T00:15:29.394579+0000","last_clean":"2023-09-28T00:15:29.394579+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:15:29.394579+0000","last_undegraded":"2023-09-28T00:15:29.394579+0000","last_fullsized":"2023-09-28T00:15:29.394579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.387663+0000","last_change":"2023-09-28T00:15:29.381022+0000","last_active":"2023-09-28T00:15:29.387663+0000","last_peered":"2023-09-28T00:15:29.387663+0000","last_clean":"2023-09-28T00:15:29.387663+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:15:29.387663+0000","last_undegraded":"2023-09-28T00:15:29.387663+0000","last_fullsized":"2023-09-28T00:15:29.387663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378888+0000","last_change":"2023-09-28T00:15:28.989043+0000","last_active":"2023-09-28T00:15:29.378888+0000","last_peered":"2023-09-28T00:15:29.378888+0000","last_clean":"2023-09-28T00:15:29.378888+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:15:29.378888+0000","last_undegraded":"2023-09-28T00:15:29.378888+0000","last_fullsized":"2023-09-28T00:15:29.378888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391650+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:15:29.391650+0000","last_peered":"2023-09-28T00:15:29.391650+0000","last_clean":"2023-09-28T00:15:29.391650+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:15:29.391650+0000","last_undegraded":"2023-09-28T00:15:29.391650+0000","last_fullsized":"2023-09-28T00:15:29.391650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399129+0000","last_change":"2023-09-28T00:15:28.981865+0000","last_active":"2023-09-28T00:15:29.399129+0000","last_peered":"2023-09-28T00:15:29.399129+0000","last_clean":"2023-09-28T00:15:29.399129+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:15:29.399129+0000","last_undegraded":"2023-09-28T00:15:29.399129+0000","last_fullsized":"2023-09-28T00:15:29.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397590+0000","last_change":"2023-09-28T00:15:29.389604+0000","last_active":"2023-09-28T00:15:29.397590+0000","last_peered":"2023-09-28T00:15:29.397590+0000","last_clean":"2023-09-28T00:15:29.397590+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:15:29.397590+0000","last_undegraded":"2023-09-28T00:15:29.397590+0000","last_fullsized":"2023-09-28T00:15:29.397590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.405038+0000","last_change":"2023-09-28T00:15:28.979093+0000","last_active":"2023-09-28T00:15:29.405038+0000","last_peered":"2023-09-28T00:15:29.405038+0000","last_clean":"2023-09-28T00:15:29.405038+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:15:29.405038+0000","last_undegraded":"2023-09-28T00:15:29.405038+0000","last_fullsized":"2023-09-28T00:15:29.405038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404103+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:15:29.404103+0000","last_peered":"2023-09-28T00:15:29.404103+0000","last_clean":"2023-09-28T00:15:29.404103+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:15:29.404103+0000","last_undegraded":"2023-09-28T00:15:29.404103+0000","last_fullsized":"2023-09-28T00:15:29.404103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:59:40.497846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403068+0000","last_change":"2023-09-28T00:15:28.985348+0000","last_active":"2023-09-28T00:15:29.403068+0000","last_peered":"2023-09-28T00:15:29.403068+0000","last_clean":"2023-09-28T00:15:29.403068+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:15:29.403068+0000","last_undegraded":"2023-09-28T00:15:29.403068+0000","last_fullsized":"2023-09-28T00:15:29.403068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390525+0000","last_change":"2023-09-28T00:15:29.383322+0000","last_active":"2023-09-28T00:15:29.390525+0000","last_peered":"2023-09-28T00:15:29.390525+0000","last_clean":"2023-09-28T00:15:29.390525+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:15:29.390525+0000","last_undegraded":"2023-09-28T00:15:29.390525+0000","last_fullsized":"2023-09-28T00:15:29.390525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390540+0000","last_change":"2023-09-28T00:15:28.987818+0000","last_active":"2023-09-28T00:15:29.390540+0000","last_peered":"2023-09-28T00:15:29.390540+0000","last_clean":"2023-09-28T00:15:29.390540+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:15:29.390540+0000","last_undegraded":"2023-09-28T00:15:29.390540+0000","last_fullsized":"2023-09-28T00:15:29.390540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397462+0000","last_change":"2023-09-28T00:15:29.395546+0000","last_active":"2023-09-28T00:15:29.397462+0000","last_peered":"2023-09-28T00:15:29.397462+0000","last_clean":"2023-09-28T00:15:29.397462+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:15:29.397462+0000","last_undegraded":"2023-09-28T00:15:29.397462+0000","last_fullsized":"2023-09-28T00:15:29.397462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380953+0000","last_change":"2023-09-28T00:15:28.985438+0000","last_active":"2023-09-28T00:15:29.380953+0000","last_peered":"2023-09-28T00:15:29.380953+0000","last_clean":"2023-09-28T00:15:29.380953+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:15:29.380953+0000","last_undegraded":"2023-09-28T00:15:29.380953+0000","last_fullsized":"2023-09-28T00:15:29.380953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402467+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:15:29.402467+0000","last_peered":"2023-09-28T00:15:29.402467+0000","last_clean":"2023-09-28T00:15:29.402467+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:15:29.402467+0000","last_undegraded":"2023-09-28T00:15:29.402467+0000","last_fullsized":"2023-09-28T00:15:29.402467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403755+0000","last_change":"2023-09-28T00:15:28.983275+0000","last_active":"2023-09-28T00:15:29.403755+0000","last_peered":"2023-09-28T00:15:29.403755+0000","last_clean":"2023-09-28T00:15:29.403755+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:15:29.403755+0000","last_undegraded":"2023-09-28T00:15:29.403755+0000","last_fullsized":"2023-09-28T00:15:29.403755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:10:17.162300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396946+0000","last_change":"2023-09-28T00:15:29.393952+0000","last_active":"2023-09-28T00:15:29.396946+0000","last_peered":"2023-09-28T00:15:29.396946+0000","last_clean":"2023-09-28T00:15:29.396946+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:15:29.396946+0000","last_undegraded":"2023-09-28T00:15:29.396946+0000","last_fullsized":"2023-09-28T00:15:29.396946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402648+0000","last_change":"2023-09-28T00:15:28.986391+0000","last_active":"2023-09-28T00:15:29.402648+0000","last_peered":"2023-09-28T00:15:29.402648+0000","last_clean":"2023-09-28T00:15:29.402648+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:15:29.402648+0000","last_undegraded":"2023-09-28T00:15:29.402648+0000","last_fullsized":"2023-09-28T00:15:29.402648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396755+0000","last_change":"2023-09-28T00:15:29.393474+0000","last_active":"2023-09-28T00:15:29.396755+0000","last_peered":"2023-09-28T00:15:29.396755+0000","last_clean":"2023-09-28T00:15:29.396755+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:15:29.396755+0000","last_undegraded":"2023-09-28T00:15:29.396755+0000","last_fullsized":"2023-09-28T00:15:29.396755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402943+0000","last_change":"2023-09-28T00:15:28.986082+0000","last_active":"2023-09-28T00:15:29.402943+0000","last_peered":"2023-09-28T00:15:29.402943+0000","last_clean":"2023-09-28T00:15:29.402943+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:15:29.402943+0000","last_undegraded":"2023-09-28T00:15:29.402943+0000","last_fullsized":"2023-09-28T00:15:29.402943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:16.392360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397610+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:15:29.397610+0000","last_peered":"2023-09-28T00:15:29.397610+0000","last_clean":"2023-09-28T00:15:29.397610+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:15:29.397610+0000","last_undegraded":"2023-09-28T00:15:29.397610+0000","last_fullsized":"2023-09-28T00:15:29.397610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:11:37.490848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399248+0000","last_change":"2023-09-28T00:15:28.982433+0000","last_active":"2023-09-28T00:15:29.399248+0000","last_peered":"2023-09-28T00:15:29.399248+0000","last_clean":"2023-09-28T00:15:29.399248+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:15:29.399248+0000","last_undegraded":"2023-09-28T00:15:29.399248+0000","last_fullsized":"2023-09-28T00:15:29.399248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:37:52.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395572+0000","last_change":"2023-09-28T00:15:29.388766+0000","last_active":"2023-09-28T00:15:29.395572+0000","last_peered":"2023-09-28T00:15:29.395572+0000","last_clean":"2023-09-28T00:15:29.395572+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:15:29.395572+0000","last_undegraded":"2023-09-28T00:15:29.395572+0000","last_fullsized":"2023-09-28T00:15:29.395572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.381202+0000","last_change":"2023-09-28T00:15:28.984089+0000","last_active":"2023-09-28T00:15:29.381202+0000","last_peered":"2023-09-28T00:15:29.381202+0000","last_clean":"2023-09-28T00:15:29.381202+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:15:29.381202+0000","last_undegraded":"2023-09-28T00:15:29.381202+0000","last_fullsized":"2023-09-28T00:15:29.381202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394391+0000","last_change":"2023-09-28T00:15:29.386850+0000","last_active":"2023-09-28T00:15:29.394391+0000","last_peered":"2023-09-28T00:15:29.394391+0000","last_clean":"2023-09-28T00:15:29.394391+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:15:29.394391+0000","last_undegraded":"2023-09-28T00:15:29.394391+0000","last_fullsized":"2023-09-28T00:15:29.394391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402306+0000","last_change":"2023-09-28T00:15:28.986069+0000","last_active":"2023-09-28T00:15:29.402306+0000","last_peered":"2023-09-28T00:15:29.402306+0000","last_clean":"2023-09-28T00:15:29.402306+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:15:29.402306+0000","last_undegraded":"2023-09-28T00:15:29.402306+0000","last_fullsized":"2023-09-28T00:15:29.402306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397756+0000","last_change":"2023-09-28T00:15:29.393182+0000","last_active":"2023-09-28T00:15:29.397756+0000","last_peered":"2023-09-28T00:15:29.397756+0000","last_clean":"2023-09-28T00:15:29.397756+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:15:29.397756+0000","last_undegraded":"2023-09-28T00:15:29.397756+0000","last_fullsized":"2023-09-28T00:15:29.397756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385144+0000","last_change":"2023-09-28T00:15:28.985291+0000","last_active":"2023-09-28T00:15:29.385144+0000","last_peered":"2023-09-28T00:15:29.385144+0000","last_clean":"2023-09-28T00:15:29.385144+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:15:29.385144+0000","last_undegraded":"2023-09-28T00:15:29.385144+0000","last_fullsized":"2023-09-28T00:15:29.385144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404083+0000","last_change":"2023-09-28T00:15:29.400083+0000","last_active":"2023-09-28T00:15:29.404083+0000","last_peered":"2023-09-28T00:15:29.404083+0000","last_clean":"2023-09-28T00:15:29.404083+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:15:29.404083+0000","last_undegraded":"2023-09-28T00:15:29.404083+0000","last_fullsized":"2023-09-28T00:15:29.404083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385946+0000","last_change":"2023-09-28T00:15:28.980715+0000","last_active":"2023-09-28T00:15:29.385946+0000","last_peered":"2023-09-28T00:15:29.385946+0000","last_clean":"2023-09-28T00:15:29.385946+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:15:29.385946+0000","last_undegraded":"2023-09-28T00:15:29.385946+0000","last_fullsized":"2023-09-28T00:15:29.385946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400065+0000","last_change":"2023-09-28T00:15:29.397875+0000","last_active":"2023-09-28T00:15:29.400065+0000","last_peered":"2023-09-28T00:15:29.400065+0000","last_clean":"2023-09-28T00:15:29.400065+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:15:29.400065+0000","last_undegraded":"2023-09-28T00:15:29.400065+0000","last_fullsized":"2023-09-28T00:15:29.400065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:35:06.112174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375411+0000","last_change":"2023-09-28T00:15:28.986410+0000","last_active":"2023-09-28T00:15:29.375411+0000","last_peered":"2023-09-28T00:15:29.375411+0000","last_clean":"2023-09-28T00:15:29.375411+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:15:29.375411+0000","last_undegraded":"2023-09-28T00:15:29.375411+0000","last_fullsized":"2023-09-28T00:15:29.375411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398187+0000","last_change":"2023-09-28T00:15:29.392748+0000","last_active":"2023-09-28T00:15:29.398187+0000","last_peered":"2023-09-28T00:15:29.398187+0000","last_clean":"2023-09-28T00:15:29.398187+0000","last_became_active":"2023-09-28T00:15:29.392336+0000","last_became_peered":"2023-09-28T00:15:29.392336+0000","last_unstale":"2023-09-28T00:15:29.398187+0000","last_undegraded":"2023-09-28T00:15:29.398187+0000","last_fullsized":"2023-09-28T00:15:29.398187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380356+0000","last_change":"2023-09-28T00:15:24.193273+0000","last_active":"2023-09-28T00:15:29.380356+0000","last_peered":"2023-09-28T00:15:29.380356+0000","last_clean":"2023-09-28T00:15:29.380356+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:15:29.380356+0000","last_undegraded":"2023-09-28T00:15:29.380356+0000","last_fullsized":"2023-09-28T00:15:29.380356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:55:44.401134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379326+0000","last_change":"2023-09-28T00:15:28.986194+0000","last_active":"2023-09-28T00:15:29.379326+0000","last_peered":"2023-09-28T00:15:29.379326+0000","last_clean":"2023-09-28T00:15:29.379326+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:15:29.379326+0000","last_undegraded":"2023-09-28T00:15:29.379326+0000","last_fullsized":"2023-09-28T00:15:29.379326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390889+0000","last_change":"2023-09-28T00:15:29.388604+0000","last_active":"2023-09-28T00:15:29.390889+0000","last_peered":"2023-09-28T00:15:29.390889+0000","last_clean":"2023-09-28T00:15:29.390889+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:15:29.390889+0000","last_undegraded":"2023-09-28T00:15:29.390889+0000","last_fullsized":"2023-09-28T00:15:29.390889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378226+0000","last_change":"2023-09-28T00:15:23.950475+0000","last_active":"2023-09-28T00:15:29.378226+0000","last_peered":"2023-09-28T00:15:29.378226+0000","last_clean":"2023-09-28T00:15:29.378226+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:15:29.378226+0000","last_undegraded":"2023-09-28T00:15:29.378226+0000","last_fullsized":"2023-09-28T00:15:29.378226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386282+0000","last_change":"2023-09-28T00:15:28.984604+0000","last_active":"2023-09-28T00:15:29.386282+0000","last_peered":"2023-09-28T00:15:29.386282+0000","last_clean":"2023-09-28T00:15:29.386282+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:15:29.386282+0000","last_undegraded":"2023-09-28T00:15:29.386282+0000","last_fullsized":"2023-09-28T00:15:29.386282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398171+0000","last_change":"2023-09-28T00:15:29.392616+0000","last_active":"2023-09-28T00:15:29.398171+0000","last_peered":"2023-09-28T00:15:29.398171+0000","last_clean":"2023-09-28T00:15:29.398171+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:15:29.398171+0000","last_undegraded":"2023-09-28T00:15:29.398171+0000","last_fullsized":"2023-09-28T00:15:29.398171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:20:56.060002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379003+0000","last_change":"2023-09-28T00:15:24.193731+0000","last_active":"2023-09-28T00:15:29.379003+0000","last_peered":"2023-09-28T00:15:29.379003+0000","last_clean":"2023-09-28T00:15:29.379003+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:15:29.379003+0000","last_undegraded":"2023-09-28T00:15:29.379003+0000","last_fullsized":"2023-09-28T00:15:29.379003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:10:07.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378537+0000","last_change":"2023-09-28T00:15:28.980294+0000","last_active":"2023-09-28T00:15:29.378537+0000","last_peered":"2023-09-28T00:15:29.378537+0000","last_clean":"2023-09-28T00:15:29.378537+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:15:29.378537+0000","last_undegraded":"2023-09-28T00:15:29.378537+0000","last_fullsized":"2023-09-28T00:15:29.378537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390883+0000","last_change":"2023-09-28T00:15:29.388008+0000","last_active":"2023-09-28T00:15:29.390883+0000","last_peered":"2023-09-28T00:15:29.390883+0000","last_clean":"2023-09-28T00:15:29.390883+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:15:29.390883+0000","last_undegraded":"2023-09-28T00:15:29.390883+0000","last_fullsized":"2023-09-28T00:15:29.390883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.377855+0000","last_change":"2023-09-28T00:15:23.950457+0000","last_active":"2023-09-28T00:15:29.377855+0000","last_peered":"2023-09-28T00:15:29.377855+0000","last_clean":"2023-09-28T00:15:29.377855+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:15:29.377855+0000","last_undegraded":"2023-09-28T00:15:29.377855+0000","last_fullsized":"2023-09-28T00:15:29.377855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380256+0000","last_change":"2023-09-28T00:15:16.995081+0000","last_active":"2023-09-28T00:15:29.380256+0000","last_peered":"2023-09-28T00:15:29.380256+0000","last_clean":"2023-09-28T00:15:29.380256+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:15:29.380256+0000","last_undegraded":"2023-09-28T00:15:29.380256+0000","last_fullsized":"2023-09-28T00:15:29.380256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_clean_scrub_stamp":"2023-09-28T00:15:15.867916+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:37:49.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375538+0000","last_change":"2023-09-28T00:15:28.985016+0000","last_active":"2023-09-28T00:15:29.375538+0000","last_peered":"2023-09-28T00:15:29.375538+0000","last_clean":"2023-09-28T00:15:29.375538+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:15:29.375538+0000","last_undegraded":"2023-09-28T00:15:29.375538+0000","last_fullsized":"2023-09-28T00:15:29.375538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403095+0000","last_change":"2023-09-28T00:15:29.401863+0000","last_active":"2023-09-28T00:15:29.403095+0000","last_peered":"2023-09-28T00:15:29.403095+0000","last_clean":"2023-09-28T00:15:29.403095+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:15:29.403095+0000","last_undegraded":"2023-09-28T00:15:29.403095+0000","last_fullsized":"2023-09-28T00:15:29.403095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:17.400054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380675+0000","last_change":"2023-09-28T00:15:23.946737+0000","last_active":"2023-09-28T00:15:29.380675+0000","last_peered":"2023-09-28T00:15:29.380675+0000","last_clean":"2023-09-28T00:15:29.380675+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:15:29.380675+0000","last_undegraded":"2023-09-28T00:15:29.380675+0000","last_fullsized":"2023-09-28T00:15:29.380675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386570+0000","last_change":"2023-09-28T00:15:28.986464+0000","last_active":"2023-09-28T00:15:29.386570+0000","last_peered":"2023-09-28T00:15:29.386570+0000","last_clean":"2023-09-28T00:15:29.386570+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:15:29.386570+0000","last_undegraded":"2023-09-28T00:15:29.386570+0000","last_fullsized":"2023-09-28T00:15:29.386570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398876+0000","last_change":"2023-09-28T00:15:29.390313+0000","last_active":"2023-09-28T00:15:29.398876+0000","last_peered":"2023-09-28T00:15:29.398876+0000","last_clean":"2023-09-28T00:15:29.398876+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:15:29.398876+0000","last_undegraded":"2023-09-28T00:15:29.398876+0000","last_fullsized":"2023-09-28T00:15:29.398876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379277+0000","last_change":"2023-09-28T00:15:24.193260+0000","last_active":"2023-09-28T00:15:29.379277+0000","last_peered":"2023-09-28T00:15:29.379277+0000","last_clean":"2023-09-28T00:15:29.379277+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:15:29.379277+0000","last_undegraded":"2023-09-28T00:15:29.379277+0000","last_fullsized":"2023-09-28T00:15:29.379277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380464+0000","last_change":"2023-09-28T00:15:28.979725+0000","last_active":"2023-09-28T00:15:29.380464+0000","last_peered":"2023-09-28T00:15:29.380464+0000","last_clean":"2023-09-28T00:15:29.380464+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:15:29.380464+0000","last_undegraded":"2023-09-28T00:15:29.380464+0000","last_fullsized":"2023-09-28T00:15:29.380464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402412+0000","last_change":"2023-09-28T00:15:29.398984+0000","last_active":"2023-09-28T00:15:29.402412+0000","last_peered":"2023-09-28T00:15:29.402412+0000","last_clean":"2023-09-28T00:15:29.402412+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:15:29.402412+0000","last_undegraded":"2023-09-28T00:15:29.402412+0000","last_fullsized":"2023-09-28T00:15:29.402412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395338+0000","last_change":"2023-09-28T00:15:28.989236+0000","last_active":"2023-09-28T00:15:29.395338+0000","last_peered":"2023-09-28T00:15:29.395338+0000","last_clean":"2023-09-28T00:15:29.395338+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:15:29.395338+0000","last_undegraded":"2023-09-28T00:15:29.395338+0000","last_fullsized":"2023-09-28T00:15:29.395338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380630+0000","last_change":"2023-09-28T00:15:23.949425+0000","last_active":"2023-09-28T00:15:29.380630+0000","last_peered":"2023-09-28T00:15:29.380630+0000","last_clean":"2023-09-28T00:15:29.380630+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:15:29.380630+0000","last_undegraded":"2023-09-28T00:15:29.380630+0000","last_fullsized":"2023-09-28T00:15:29.380630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:59:04.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391469+0000","last_change":"2023-09-28T00:15:29.386508+0000","last_active":"2023-09-28T00:15:29.391469+0000","last_peered":"2023-09-28T00:15:29.391469+0000","last_clean":"2023-09-28T00:15:29.391469+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:15:29.391469+0000","last_undegraded":"2023-09-28T00:15:29.391469+0000","last_fullsized":"2023-09-28T00:15:29.391469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385234+0000","last_change":"2023-09-28T00:15:23.949692+0000","last_active":"2023-09-28T00:15:29.385234+0000","last_peered":"2023-09-28T00:15:29.385234+0000","last_clean":"2023-09-28T00:15:29.385234+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:15:29.385234+0000","last_undegraded":"2023-09-28T00:15:29.385234+0000","last_fullsized":"2023-09-28T00:15:29.385234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:48:11.275095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778335+0000","last_change":"2023-09-28T00:15:28.988077+0000","last_active":"2023-09-28T00:15:30.778335+0000","last_peered":"2023-09-28T00:15:30.778335+0000","last_clean":"2023-09-28T00:15:30.778335+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:15:30.778335+0000","last_undegraded":"2023-09-28T00:15:30.778335+0000","last_fullsized":"2023-09-28T00:15:30.778335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399373+0000","last_change":"2023-09-28T00:15:29.398170+0000","last_active":"2023-09-28T00:15:29.399373+0000","last_peered":"2023-09-28T00:15:29.399373+0000","last_clean":"2023-09-28T00:15:29.399373+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:15:29.399373+0000","last_undegraded":"2023-09-28T00:15:29.399373+0000","last_fullsized":"2023-09-28T00:15:29.399373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:30:23.382889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402252+0000","last_change":"2023-09-28T00:15:28.987224+0000","last_active":"2023-09-28T00:15:29.402252+0000","last_peered":"2023-09-28T00:15:29.402252+0000","last_clean":"2023-09-28T00:15:29.402252+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:15:29.402252+0000","last_undegraded":"2023-09-28T00:15:29.402252+0000","last_fullsized":"2023-09-28T00:15:29.402252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391371+0000","last_change":"2023-09-28T00:15:29.383759+0000","last_active":"2023-09-28T00:15:29.391371+0000","last_peered":"2023-09-28T00:15:29.391371+0000","last_clean":"2023-09-28T00:15:29.391371+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:15:29.391371+0000","last_undegraded":"2023-09-28T00:15:29.391371+0000","last_fullsized":"2023-09-28T00:15:29.391371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:06.286162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402275+0000","last_change":"2023-09-28T00:15:28.987633+0000","last_active":"2023-09-28T00:15:29.402275+0000","last_peered":"2023-09-28T00:15:29.402275+0000","last_clean":"2023-09-28T00:15:29.402275+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:15:29.402275+0000","last_undegraded":"2023-09-28T00:15:29.402275+0000","last_fullsized":"2023-09-28T00:15:29.402275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398131+0000","last_change":"2023-09-28T00:15:29.392897+0000","last_active":"2023-09-28T00:15:29.398131+0000","last_peered":"2023-09-28T00:15:29.398131+0000","last_clean":"2023-09-28T00:15:29.398131+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:15:29.398131+0000","last_undegraded":"2023-09-28T00:15:29.398131+0000","last_fullsized":"2023-09-28T00:15:29.398131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403684+0000","last_change":"2023-09-28T00:15:28.987962+0000","last_active":"2023-09-28T00:15:29.403684+0000","last_peered":"2023-09-28T00:15:29.403684+0000","last_clean":"2023-09-28T00:15:29.403684+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:15:29.403684+0000","last_undegraded":"2023-09-28T00:15:29.403684+0000","last_fullsized":"2023-09-28T00:15:29.403684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399076+0000","last_change":"2023-09-28T00:15:29.394598+0000","last_active":"2023-09-28T00:15:29.399076+0000","last_peered":"2023-09-28T00:15:29.399076+0000","last_clean":"2023-09-28T00:15:29.399076+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:15:29.399076+0000","last_undegraded":"2023-09-28T00:15:29.399076+0000","last_fullsized":"2023-09-28T00:15:29.399076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396285+0000","last_change":"2023-09-28T00:15:28.983686+0000","last_active":"2023-09-28T00:15:29.396285+0000","last_peered":"2023-09-28T00:15:29.396285+0000","last_clean":"2023-09-28T00:15:29.396285+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:15:29.396285+0000","last_undegraded":"2023-09-28T00:15:29.396285+0000","last_fullsized":"2023-09-28T00:15:29.396285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391633+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:15:29.391633+0000","last_peered":"2023-09-28T00:15:29.391633+0000","last_clean":"2023-09-28T00:15:29.391633+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:15:29.391633+0000","last_undegraded":"2023-09-28T00:15:29.391633+0000","last_fullsized":"2023-09-28T00:15:29.391633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402519+0000","last_change":"2023-09-28T00:15:28.985280+0000","last_active":"2023-09-28T00:15:29.402519+0000","last_peered":"2023-09-28T00:15:29.402519+0000","last_clean":"2023-09-28T00:15:29.402519+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:15:29.402519+0000","last_undegraded":"2023-09-28T00:15:29.402519+0000","last_fullsized":"2023-09-28T00:15:29.402519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400030+0000","last_change":"2023-09-28T00:15:29.398360+0000","last_active":"2023-09-28T00:15:29.400030+0000","last_peered":"2023-09-28T00:15:29.400030+0000","last_clean":"2023-09-28T00:15:29.400030+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:15:29.400030+0000","last_undegraded":"2023-09-28T00:15:29.400030+0000","last_fullsized":"2023-09-28T00:15:29.400030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:58:13.878285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400854+0000","last_change":"2023-09-28T00:15:29.395080+0000","last_active":"2023-09-28T00:15:29.400854+0000","last_peered":"2023-09-28T00:15:29.400854+0000","last_clean":"2023-09-28T00:15:29.400854+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:15:29.400854+0000","last_undegraded":"2023-09-28T00:15:29.400854+0000","last_fullsized":"2023-09-28T00:15:29.400854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:39.792299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391615+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:15:29.391615+0000","last_peered":"2023-09-28T00:15:29.391615+0000","last_clean":"2023-09-28T00:15:29.391615+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:15:29.391615+0000","last_undegraded":"2023-09-28T00:15:29.391615+0000","last_fullsized":"2023-09-28T00:15:29.391615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403283+0000","last_change":"2023-09-28T00:15:29.399203+0000","last_active":"2023-09-28T00:15:29.403283+0000","last_peered":"2023-09-28T00:15:29.403283+0000","last_clean":"2023-09-28T00:15:29.403283+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:15:29.403283+0000","last_undegraded":"2023-09-28T00:15:29.403283+0000","last_fullsized":"2023-09-28T00:15:29.403283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:47:48.079491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391392+0000","last_change":"2023-09-28T00:15:29.388644+0000","last_active":"2023-09-28T00:15:29.391392+0000","last_peered":"2023-09-28T00:15:29.391392+0000","last_clean":"2023-09-28T00:15:29.391392+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:15:29.391392+0000","last_undegraded":"2023-09-28T00:15:29.391392+0000","last_fullsized":"2023-09-28T00:15:29.391392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390790+0000","last_change":"2023-09-28T00:15:29.388432+0000","last_active":"2023-09-28T00:15:29.390790+0000","last_peered":"2023-09-28T00:15:29.390790+0000","last_clean":"2023-09-28T00:15:29.390790+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:15:29.390790+0000","last_undegraded":"2023-09-28T00:15:29.390790+0000","last_fullsized":"2023-09-28T00:15:29.390790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8004,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363836,"statfs":{"total":96636764160,"available":96628568064,"internally_reserved":0,"allocated":258048,"data_stored":93762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9092,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362748,"statfs":{"total":96636764160,"available":96627453952,"internally_reserved":0,"allocated":847872,"data_stored":684060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.901}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.548}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9116,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362724,"statfs":{"total":96636764160,"available":96627429376,"internally_reserved":0,"allocated":872448,"data_stored":685258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7932,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363908,"statfs":{"total":96636764160,"available":96628641792,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":93228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":270336,"data_stored":94730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:15:36.788 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-28T00:15:36.788 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-28T00:15:36.788 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-28T00:15:36.788 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-28T00:15:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.938+0000 7f4c5ffa4700 1 Processor -- start 2023-09-28T00:15:36.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.939+0000 7f4c5ffa4700 1 -- start start 2023-09-28T00:15:36.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.939+0000 7f4c5ffa4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5815d560 0x7f4c580d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.939+0000 7f4c5ffa4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4c5815d930 0x7f4c580b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.939+0000 7f4c5ffa4700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c580b2ad0 con 0x7f4c581591b0 2023-09-28T00:15:36.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.939+0000 7f4c5ffa4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c580b4160 con 0x7f4c5815d930 2023-09-28T00:15:36.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.939+0000 7f4c5ffa4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580b1f80 con 0x7f4c5815d560 2023-09-28T00:15:36.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5dd40700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5815d560 0x7f4c580d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5d53f700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4c5815d930 0x7f4c580b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5dd40700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5815d560 0x7f4c580d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34740/0 (socket says 172.21.15.26:34740) 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5dd40700 1 -- 172.21.15.26:0/3679098779 learned_addr learned my addr 172.21.15.26:0/3679098779 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5e541700 1 --1- 172.21.15.26:0/3679098779 >> v1:172.21.15.190:6789/0 conn(0x7f4c581591b0 0x7f4c58159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:48700/0 (socket says 172.21.15.26:48700) 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5dd40700 1 -- 172.21.15.26:0/3679098779 >> v2:172.21.15.190:3300/0 conn(0x7f4c5815d930 msgr2=0x7f4c580b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5dd40700 1 --2- 172.21.15.26:0/3679098779 >> v2:172.21.15.190:3300/0 conn(0x7f4c5815d930 0x7f4c580b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5dd40700 1 -- 172.21.15.26:0/3679098779 >> v1:172.21.15.190:6789/0 conn(0x7f4c581591b0 legacy=0x7f4c58159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5dd40700 1 -- 172.21.15.26:0/3679098779 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580b2230 con 0x7f4c5815d560 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5dd40700 1 --2- 172.21.15.26:0/3679098779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5815d560 0x7f4c580d0030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c500099b0 tx=0x7f4c50009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eafe30a60062c52a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5cd3e700 1 -- 172.21.15.26:0/3679098779 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c50009ea0 con 0x7f4c5815d560 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5cd3e700 1 -- 172.21.15.26:0/3679098779 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5000b860 con 0x7f4c5815d560 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.940+0000 7f4c5cd3e700 1 -- 172.21.15.26:0/3679098779 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000bc00 con 0x7f4c5815d560 2023-09-28T00:15:36.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.941+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/3679098779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5815d560 msgr2=0x7f4c580d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.941+0000 7f4c5ffa4700 1 --2- 172.21.15.26:0/3679098779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5815d560 0x7f4c580d0030 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4c500099b0 tx=0x7f4c50009250 comp rx=0 tx=0).stop 2023-09-28T00:15:36.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.941+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/3679098779 shutdown_connections 2023-09-28T00:15:36.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.941+0000 7f4c5ffa4700 1 --2- 172.21.15.26:0/3679098779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c5815d560 0x7f4c580d0030 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.941+0000 7f4c5ffa4700 1 --2- 172.21.15.26:0/3679098779 >> v2:172.21.15.190:3300/0 conn(0x7f4c5815d930 0x7f4c580b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.941+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/3679098779 >> 172.21.15.26:0/3679098779 conn(0x7f4c580d1180 msgr2=0x7f4c58069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:36.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.941+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/3679098779 shutdown_connections 2023-09-28T00:15:36.944 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.941+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/3679098779 wait complete. 2023-09-28T00:15:36.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.942+0000 7f4c5ffa4700 1 Processor -- start 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.942+0000 7f4c5ffa4700 1 -- start start 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5ffa4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c581591b0 0x7f4c5815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5ffa4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5815d560 0x7f4c58151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5ffa4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5815d930 0x7f4c5815c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5ffa4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5815c250 con 0x7f4c5815d560 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5ffa4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5815b640 con 0x7f4c5815d930 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5ffa4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5815b920 con 0x7f4c581591b0 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5d53f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5815d560 0x7f4c58151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5d53f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5815d560 0x7f4c58151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46718/0 (socket says 172.21.15.26:46718) 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5d53f700 1 -- 172.21.15.26:0/9472747 learned_addr learned my addr 172.21.15.26:0/9472747 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:36.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5e541700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5815d930 0x7f4c5815c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5dd40700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c581591b0 0x7f4c5815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5d53f700 1 -- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c581591b0 msgr2=0x7f4c5815ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5d53f700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c581591b0 0x7f4c5815ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5d53f700 1 -- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5815d930 msgr2=0x7f4c5815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5d53f700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5815d930 0x7f4c5815c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.943+0000 7f4c5d53f700 1 -- 172.21.15.26:0/9472747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500094f0 con 0x7f4c5815d560 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.944+0000 7f4c5d53f700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5815d560 0x7f4c58151190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00ec80 tx=0x7f4c4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.944+0000 7f4c55ffb700 1 -- 172.21.15.26:0/9472747 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00c850 con 0x7f4c5815d560 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.944+0000 7f4c55ffb700 1 -- 172.21.15.26:0/9472747 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4c00c9b0 con 0x7f4c5815d560 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.944+0000 7f4c55ffb700 1 -- 172.21.15.26:0/9472747 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4c00cd50 con 0x7f4c5815d560 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.944+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5815bc00 con 0x7f4c5815d560 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.944+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5815b270 con 0x7f4c5815d560 2023-09-28T00:15:36.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.945+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5815c400 con 0x7f4c5815d560 2023-09-28T00:15:36.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.945+0000 7f4c55ffb700 1 -- 172.21.15.26:0/9472747 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4c4c013680 con 0x7f4c5815d560 2023-09-28T00:15:36.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.946+0000 7f4c55ffb700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4c44067330 0x7f4c440697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:36.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.946+0000 7f4c55ffb700 1 -- 172.21.15.26:0/9472747 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4c4c084e30 con 0x7f4c5815d560 2023-09-28T00:15:36.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.946+0000 7f4c5dd40700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4c44067330 0x7f4c440697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:36.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.946+0000 7f4c5dd40700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4c44067330 0x7f4c440697e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c500099b0 tx=0x7f4c50017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:36.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:36.950+0000 7f4c55ffb700 1 -- 172.21.15.26:0/9472747 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4c5815c400 con 0x7f4c5815d560 2023-09-28T00:15:37.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.184+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4c58064050 con 0x7f4c5815d560 2023-09-28T00:15:37.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.184+0000 7f4c55ffb700 1 -- 172.21.15.26:0/9472747 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4c4c051c90 con 0x7f4c5815d560 2023-09-28T00:15:37.185 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:37.186 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-28T00:15:37.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4c44067330 msgr2=0x7f4c440697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4c44067330 0x7f4c440697e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c500099b0 tx=0x7f4c50017000 comp rx=0 tx=0).stop 2023-09-28T00:15:37.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5815d560 msgr2=0x7f4c58151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5815d560 0x7f4c58151190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00ec80 tx=0x7f4c4c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 shutdown_connections 2023-09-28T00:15:37.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4c44067330 0x7f4c440697e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4c581591b0 0x7f4c5815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4c5815d930 0x7f4c5815c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 --2- 172.21.15.26:0/9472747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4c5815d560 0x7f4c58151190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.186+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 >> 172.21.15.26:0/9472747 conn(0x7f4c580d1180 msgr2=0x7f4c580b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:37.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.187+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 shutdown_connections 2023-09-28T00:15:37.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.187+0000 7f4c5ffa4700 1 -- 172.21.15.26:0/9472747 wait complete. 2023-09-28T00:15:37.199 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-28T00:15:37.200 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:37.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.317+0000 7f107717e700 1 Processor -- start 2023-09-28T00:15:37.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.317+0000 7f107717e700 1 -- start start 2023-09-28T00:15:37.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.318+0000 7f107717e700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f10700c6dc0 0x7f10700ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.318+0000 7f107717e700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700ae140 con 0x7f10700cbe50 2023-09-28T00:15:37.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.318+0000 7f107717e700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700cc2a0 con 0x7f10700cdc00 2023-09-28T00:15:37.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.318+0000 7f107717e700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10700ad530 con 0x7f10700c6dc0 2023-09-28T00:15:37.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.318+0000 7f106ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f10700cbe50 0x7f10700c66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44026/0 (socket says 172.21.15.26:44026) 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.318+0000 7f106ffff700 1 -- 172.21.15.26:0/3719470451 learned_addr learned my addr 172.21.15.26:0/3719470451 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.318+0000 7f107571b700 1 --2- 172.21.15.26:0/3719470451 >> v2:172.21.15.190:3300/0 conn(0x7f10700c6dc0 0x7f10700ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.319+0000 7f106f7fe700 1 -- 172.21.15.26:0/3719470451 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161640513 0 0) 0x7f10700ae140 con 0x7f10700cbe50 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.319+0000 7f106f7fe700 1 -- 172.21.15.26:0/3719470451 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f105c003570 con 0x7f10700cbe50 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.319+0000 7f107571b700 1 -- 172.21.15.26:0/3719470451 >> v1:172.21.15.190:6789/0 conn(0x7f10700cdc00 legacy=0x7f10700d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.319+0000 7f107571b700 1 -- 172.21.15.26:0/3719470451 >> v1:172.21.15.26:6789/0 conn(0x7f10700cbe50 legacy=0x7f10700c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.319+0000 7f107571b700 1 -- 172.21.15.26:0/3719470451 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700ad810 con 0x7f10700c6dc0 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.319+0000 7f107571b700 1 --2- 172.21.15.26:0/3719470451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 0x7f10700ae5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10580098e0 tx=0x7f10580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=476fafffcd59ee3a server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.319+0000 7f106f7fe700 1 -- 172.21.15.26:0/3719470451 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800b640 con 0x7f10700c6dc0 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.319+0000 7f106f7fe700 1 -- 172.21.15.26:0/3719470451 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105800b7a0 con 0x7f10700c6dc0 2023-09-28T00:15:37.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.319+0000 7f106f7fe700 1 -- 172.21.15.26:0/3719470451 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105800bb40 con 0x7f10700c6dc0 2023-09-28T00:15:37.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.320+0000 7f107717e700 1 -- 172.21.15.26:0/3719470451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 msgr2=0x7f10700ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.320+0000 7f107717e700 1 --2- 172.21.15.26:0/3719470451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 0x7f10700ae5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10580098e0 tx=0x7f10580091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.320+0000 7f107717e700 1 -- 172.21.15.26:0/3719470451 shutdown_connections 2023-09-28T00:15:37.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.320+0000 7f107717e700 1 --2- 172.21.15.26:0/3719470451 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 0x7f10700ae5d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.320+0000 7f107717e700 1 -- 172.21.15.26:0/3719470451 >> 172.21.15.26:0/3719470451 conn(0x7f1070099990 msgr2=0x7f10700b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:37.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.320+0000 7f107717e700 1 -- 172.21.15.26:0/3719470451 shutdown_connections 2023-09-28T00:15:37.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.320+0000 7f107717e700 1 -- 172.21.15.26:0/3719470451 wait complete. 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.321+0000 7f107717e700 1 Processor -- start 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.321+0000 7f107717e700 1 -- start start 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f107717e700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 0x7f1070158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f107717e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700cbe50 0x7f1070154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f107717e700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700cdc00 0x7f10700d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f107717e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070157a30 con 0x7f10700cbe50 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f107717e700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1070156e20 con 0x7f10700c6dc0 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f107717e700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1070157100 con 0x7f10700cdc00 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700cbe50 0x7f1070154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700cbe50 0x7f1070154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46720/0 (socket says 172.21.15.26:46720) 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106ffff700 1 -- 172.21.15.26:0/453338105 learned_addr learned my addr 172.21.15.26:0/453338105 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:37.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f1074f1a700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 0x7f1070158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f107571b700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700cdc00 0x7f10700d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106ffff700 1 -- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700cdc00 msgr2=0x7f10700d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106ffff700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700cdc00 0x7f10700d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106ffff700 1 -- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 msgr2=0x7f1070158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106ffff700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 0x7f1070158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106ffff700 1 -- 172.21.15.26:0/453338105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009420 con 0x7f10700cbe50 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f1074f1a700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 0x7f1070158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106ffff700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700cbe50 0x7f1070154c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f106000c7c0 tx=0x7f1060007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106cff9700 1 -- 172.21.15.26:0/453338105 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060005b30 con 0x7f10700cbe50 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.322+0000 7f106cff9700 1 -- 172.21.15.26:0/453338105 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060005c90 con 0x7f10700cbe50 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.323+0000 7f106cff9700 1 -- 172.21.15.26:0/453338105 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060007340 con 0x7f10700cbe50 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.323+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10701573e0 con 0x7f10700cbe50 2023-09-28T00:15:37.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.323+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1070158e60 con 0x7f10700cbe50 2023-09-28T00:15:37.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.324+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1070064050 con 0x7f10700cbe50 2023-09-28T00:15:37.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.324+0000 7f106cff9700 1 -- 172.21.15.26:0/453338105 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f106001b400 con 0x7f10700cbe50 2023-09-28T00:15:37.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.324+0000 7f106cff9700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1050067330 0x7f10500697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.325+0000 7f106cff9700 1 -- 172.21.15.26:0/453338105 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1060084700 con 0x7f10700cbe50 2023-09-28T00:15:37.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.325+0000 7f1074f1a700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1050067330 0x7f10500697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.325+0000 7f1074f1a700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1050067330 0x7f10500697e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1068002280 tx=0x7f1068009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:37.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.329+0000 7f106cff9700 1 -- 172.21.15.26:0/453338105 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1060051680 con 0x7f10700cbe50 2023-09-28T00:15:37.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.526+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10700b61f0 con 0x7f10700cbe50 2023-09-28T00:15:37.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.527+0000 7f106cff9700 1 -- 172.21.15.26:0/453338105 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f1060054ca0 con 0x7f10700cbe50 2023-09-28T00:15:37.529 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:37.529 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:30.373905+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1050067330 msgr2=0x7f10500697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1050067330 0x7f10500697e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1068002280 tx=0x7f1068009040 comp rx=0 tx=0).stop 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700cbe50 msgr2=0x7f1070154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700cbe50 0x7f1070154c30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f106000c7c0 tx=0x7f1060007e00 comp rx=0 tx=0).stop 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 shutdown_connections 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1050067330 0x7f10500697e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700cdc00 0x7f10700d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c6dc0 0x7f1070158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 --2- 172.21.15.26:0/453338105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700cbe50 0x7f1070154c30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 >> 172.21.15.26:0/453338105 conn(0x7f1070099990 msgr2=0x7f10700cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:37.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 shutdown_connections 2023-09-28T00:15:37.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.529+0000 7f107717e700 1 -- 172.21.15.26:0/453338105 wait complete. 2023-09-28T00:15:37.542 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T00:15:15.721561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T00:15:22.381112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-28T00:15:27.106757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-28T00:15:28.347923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-28T00:15:37.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T00:15:37.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.664+0000 7fc8dc749700 1 Processor -- start 2023-09-28T00:15:37.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.664+0000 7fc8dc749700 1 -- start start 2023-09-28T00:15:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.665+0000 7fc8dc749700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc8d40b15a0 0x7fc8d40abf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.665+0000 7fc8dc749700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40b1970 0x7fc8d40c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.665+0000 7fc8dc749700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d40c8e10 con 0x7fc8d40cb3d0 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.665+0000 7fc8dc749700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8d40ac440 con 0x7fc8d40b15a0 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.665+0000 7fc8dc749700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40ac630 con 0x7fc8d40b1970 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8d9ce4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40b1970 0x7fc8d40c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8da4e5700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc8d40b15a0 0x7fc8d40abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8dace6700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fc8d40cb3d0 0x7fc8d40cb830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:48722/0 (socket says 172.21.15.26:48722) 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8dace6700 1 -- 172.21.15.26:0/2683302389 learned_addr learned my addr 172.21.15.26:0/2683302389 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8d9ce4700 1 -- 172.21.15.26:0/2683302389 >> v2:172.21.15.190:3300/0 conn(0x7fc8d40b15a0 msgr2=0x7fc8d40abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8d9ce4700 1 --2- 172.21.15.26:0/2683302389 >> v2:172.21.15.190:3300/0 conn(0x7fc8d40b15a0 0x7fc8d40abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8d9ce4700 1 -- 172.21.15.26:0/2683302389 >> v1:172.21.15.190:6789/0 conn(0x7fc8d40cb3d0 legacy=0x7fc8d40cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8d9ce4700 1 -- 172.21.15.26:0/2683302389 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d40ac910 con 0x7fc8d40b1970 2023-09-28T00:15:37.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8da4e5700 1 --2- 172.21.15.26:0/2683302389 >> v2:172.21.15.190:3300/0 conn(0x7fc8d40b15a0 0x7fc8d40abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:37.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8d9ce4700 1 --2- 172.21.15.26:0/2683302389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40b1970 0x7fc8d40c88d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80098e0 tx=0x7fc8c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89b24ba20a401b9d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:37.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.666+0000 7fc8d94e3700 1 -- 172.21.15.26:0/2683302389 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800b640 con 0x7fc8d40b1970 2023-09-28T00:15:37.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8d94e3700 1 -- 172.21.15.26:0/2683302389 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c800b7a0 con 0x7fc8d40b1970 2023-09-28T00:15:37.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8d94e3700 1 -- 172.21.15.26:0/2683302389 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800bb40 con 0x7fc8d40b1970 2023-09-28T00:15:37.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8dc749700 1 -- 172.21.15.26:0/2683302389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40b1970 msgr2=0x7fc8d40c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8dc749700 1 --2- 172.21.15.26:0/2683302389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40b1970 0x7fc8d40c88d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80098e0 tx=0x7fc8c80091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8dc749700 1 -- 172.21.15.26:0/2683302389 shutdown_connections 2023-09-28T00:15:37.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8dc749700 1 --2- 172.21.15.26:0/2683302389 >> v2:172.21.15.190:3300/0 conn(0x7fc8d40b15a0 0x7fc8d40abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8dc749700 1 --2- 172.21.15.26:0/2683302389 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40b1970 0x7fc8d40c88d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8dc749700 1 -- 172.21.15.26:0/2683302389 >> 172.21.15.26:0/2683302389 conn(0x7fc8d40680b0 msgr2=0x7fc8d40684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8dc749700 1 -- 172.21.15.26:0/2683302389 shutdown_connections 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.667+0000 7fc8dc749700 1 -- 172.21.15.26:0/2683302389 wait complete. 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.668+0000 7fc8dc749700 1 Processor -- start 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.668+0000 7fc8dc749700 1 -- start start 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8dc749700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d40b15a0 0x7fc8d4096a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8dc749700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d40b1970 0x7fc8d4098640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8dc749700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40cb3d0 0x7fc8d4098b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8dc749700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40b0800 con 0x7fc8d40b15a0 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8dc749700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40afbf0 con 0x7fc8d40b1970 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8dc749700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d40afed0 con 0x7fc8d40cb3d0 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8da4e5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d40b15a0 0x7fc8d4096a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8da4e5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d40b15a0 0x7fc8d4096a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46736/0 (socket says 172.21.15.26:46736) 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8da4e5700 1 -- 172.21.15.26:0/3454383941 learned_addr learned my addr 172.21.15.26:0/3454383941 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8d9ce4700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d40b1970 0x7fc8d4098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8dace6700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40cb3d0 0x7fc8d4098b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8da4e5700 1 -- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40cb3d0 msgr2=0x7fc8d4098b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8da4e5700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40cb3d0 0x7fc8d4098b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8da4e5700 1 -- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d40b1970 msgr2=0x7fc8d4098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8da4e5700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d40b1970 0x7fc8d4098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8da4e5700 1 -- 172.21.15.26:0/3454383941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8cc009420 con 0x7fc8d40b15a0 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.669+0000 7fc8dace6700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40cb3d0 0x7fc8d4098b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.670+0000 7fc8da4e5700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d40b15a0 0x7fc8d4096a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00ec80 tx=0x7fc8cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.670+0000 7fc8d27fc700 1 -- 172.21.15.26:0/3454383941 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00c8f0 con 0x7fc8d40b15a0 2023-09-28T00:15:37.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.670+0000 7fc8d27fc700 1 -- 172.21.15.26:0/3454383941 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc00ca50 con 0x7fc8d40b15a0 2023-09-28T00:15:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.670+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c8009420 con 0x7fc8d40b15a0 2023-09-28T00:15:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.670+0000 7fc8d27fc700 1 -- 172.21.15.26:0/3454383941 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00cdd0 con 0x7fc8d40b15a0 2023-09-28T00:15:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.670+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d40b0490 con 0x7fc8d40b15a0 2023-09-28T00:15:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.671+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d4064050 con 0x7fc8d40b15a0 2023-09-28T00:15:37.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.671+0000 7fc8d27fc700 1 -- 172.21.15.26:0/3454383941 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc8cc013680 con 0x7fc8d40b15a0 2023-09-28T00:15:37.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.671+0000 7fc8d27fc700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc8c0067330 0x7fc8c00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:37.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.672+0000 7fc8d27fc700 1 -- 172.21.15.26:0/3454383941 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc8cc085270 con 0x7fc8d40b15a0 2023-09-28T00:15:37.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.672+0000 7fc8d9ce4700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc8c0067330 0x7fc8c00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:37.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.672+0000 7fc8d9ce4700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc8c0067330 0x7fc8c00697e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80093f0 tx=0x7fc8c8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:37.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.676+0000 7fc8d27fc700 1 -- 172.21.15.26:0/3454383941 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc8cc052170 con 0x7fc8d40b15a0 2023-09-28T00:15:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.867+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8d4099ef0 con 0x7fc8d40b15a0 2023-09-28T00:15:37.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.868+0000 7fc8d27fc700 1 -- 172.21.15.26:0/3454383941 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8cc055790 con 0x7fc8d40b15a0 2023-09-28T00:15:37.869 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-09-28T00:15:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc8c0067330 msgr2=0x7fc8c00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc8c0067330 0x7fc8c00697e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80093f0 tx=0x7fc8c8017000 comp rx=0 tx=0).stop 2023-09-28T00:15:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d40b15a0 msgr2=0x7fc8d4096a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:37.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d40b15a0 0x7fc8d4096a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc8cc00ec80 tx=0x7fc8cc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 shutdown_connections 2023-09-28T00:15:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc8c0067330 0x7fc8c00697e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8d40cb3d0 0x7fc8d4098b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8d40b15a0 0x7fc8d4096a60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 --2- 172.21.15.26:0/3454383941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8d40b1970 0x7fc8d4098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 >> 172.21.15.26:0/3454383941 conn(0x7fc8d40680b0 msgr2=0x7fc8d406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 shutdown_connections 2023-09-28T00:15:37.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:37.870+0000 7fc8dc749700 1 -- 172.21.15.26:0/3454383941 wait complete. 2023-09-28T00:15:37.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T00:15:38.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.004+0000 7fad493fa700 1 Processor -- start 2023-09-28T00:15:38.005 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.004+0000 7fad493fa700 1 -- start start 2023-09-28T00:15:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad493fa700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fad44159500 0x7fad441598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad493fa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad4415dab0 0x7fad440cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad493fa700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440b1110 con 0x7fad440b3fd0 2023-09-28T00:15:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad493fa700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440b13b0 con 0x7fad44159500 2023-09-28T00:15:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad493fa700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad440b1690 con 0x7fad4415dab0 2023-09-28T00:15:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad427fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fad440b3fd0 0x7fad4415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44036/0 (socket says 172.21.15.26:44036) 2023-09-28T00:15:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad427fc700 1 -- 172.21.15.26:0/3452584173 learned_addr learned my addr 172.21.15.26:0/3452584173 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad437fe700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad4415dab0 0x7fad440cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad42ffd700 1 --2- 172.21.15.26:0/3452584173 >> v2:172.21.15.190:3300/0 conn(0x7fad44159500 0x7fad441598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639307276 0 0) 0x7fad440b1110 con 0x7fad440b3fd0 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.005+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad30003570 con 0x7fad440b3fd0 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2870860547 0 0) 0x7fad30003570 con 0x7fad440b3fd0 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad4415dab0 msgr2=0x7fad440cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad4415dab0 0x7fad440cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 >> v2:172.21.15.190:3300/0 conn(0x7fad44159500 msgr2=0x7fad441598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 --2- 172.21.15.26:0/3452584173 >> v2:172.21.15.190:3300/0 conn(0x7fad44159500 0x7fad441598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440b1970 con 0x7fad440b3fd0 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fad2c001470 con 0x7fad440b3fd0 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 >> v1:172.21.15.26:6789/0 conn(0x7fad440b3fd0 legacy=0x7fad4415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad30003a60 0x7fad30003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad4415dab0 0x7fad30004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440b13b0 con 0x7fad30004d50 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440b1690 con 0x7fad30003a60 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3000ba60 con 0x7fad4415dab0 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad437fe700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad42ffd700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad30003a60 0x7fad30003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad427fc700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad4415dab0 0x7fad30004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad437fe700 1 -- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad4415dab0 msgr2=0x7fad30004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad437fe700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad4415dab0 0x7fad30004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad437fe700 1 -- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad30003a60 msgr2=0x7fad30003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad437fe700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad30003a60 0x7fad30003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad437fe700 1 -- 172.21.15.26:0/3452584173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30003570 con 0x7fad30004d50 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad437fe700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad300051c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fad4415deb0 tx=0x7fad340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdd7fd58e73e563 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3400e6b0 con 0x7fad30004d50 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.006+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3400e810 con 0x7fad30004d50 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.007+0000 7fad41ffb700 1 -- 172.21.15.26:0/3452584173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3400ebd0 con 0x7fad30004d50 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.007+0000 7fad493fa700 1 -- 172.21.15.26:0/3452584173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 msgr2=0x7fad300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.007+0000 7fad493fa700 1 --2- 172.21.15.26:0/3452584173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad300051c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fad4415deb0 tx=0x7fad340091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.007+0000 7fad437fe700 1 -- 172.21.15.26:0/3452584173 reap_dead start 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.007+0000 7fad493fa700 1 -- 172.21.15.26:0/3452584173 shutdown_connections 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.007+0000 7fad493fa700 1 -- 172.21.15.26:0/3452584173 >> 172.21.15.26:0/3452584173 conn(0x7fad44067630 msgr2=0x7fad44069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.007+0000 7fad493fa700 1 -- 172.21.15.26:0/3452584173 shutdown_connections 2023-09-28T00:15:38.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.007+0000 7fad493fa700 1 -- 172.21.15.26:0/3452584173 wait complete. 2023-09-28T00:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.008+0000 7fad493fa700 1 Processor -- start 2023-09-28T00:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.008+0000 7fad493fa700 1 -- start start 2023-09-28T00:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad493fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad441526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad493fa700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad440c5440 0x7fad440c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad493fa700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad44156ec0 0x7fad44157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad493fa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad441578a0 con 0x7fad30004d50 2023-09-28T00:15:38.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad493fa700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad44152bf0 con 0x7fad440c5440 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad493fa700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad44169920 con 0x7fad44156ec0 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad42ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad441526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad42ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad441526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46754/0 (socket says 172.21.15.26:46754) 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad42ffd700 1 -- 172.21.15.26:0/1861144267 learned_addr learned my addr 172.21.15.26:0/1861144267 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad437fe700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad44156ec0 0x7fad44157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad427fc700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad440c5440 0x7fad440c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad42ffd700 1 -- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad44156ec0 msgr2=0x7fad44157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad42ffd700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad44156ec0 0x7fad44157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad42ffd700 1 -- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad440c5440 msgr2=0x7fad440c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad42ffd700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad440c5440 0x7fad440c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad42ffd700 1 -- 172.21.15.26:0/1861144267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad44169c00 con 0x7fad30004d50 2023-09-28T00:15:38.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.009+0000 7fad427fc700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad440c5440 0x7fad440c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.010+0000 7fad42ffd700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad441526b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009fd0 tx=0x7fad3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.010+0000 7fad3affd700 1 -- 172.21.15.26:0/1861144267 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c00e040 con 0x7fad30004d50 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.010+0000 7fad3affd700 1 -- 172.21.15.26:0/1861144267 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3c00f040 con 0x7fad30004d50 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.010+0000 7fad3affd700 1 -- 172.21.15.26:0/1861144267 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3c015430 con 0x7fad30004d50 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.010+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad44169ee0 con 0x7fad30004d50 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.010+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4416a4a0 con 0x7fad30004d50 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.011+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad4416a6c0 con 0x7fad30004d50 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.011+0000 7fad3affd700 1 -- 172.21.15.26:0/1861144267 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fad3c015860 con 0x7fad30004d50 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.011+0000 7fad3affd700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad24067330 0x7fad240697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.011+0000 7fad3affd700 1 -- 172.21.15.26:0/1861144267 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad3c0858a0 con 0x7fad30004d50 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.012+0000 7fad427fc700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad24067330 0x7fad240697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.012+0000 7fad427fc700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad24067330 0x7fad240697e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0015a0 tx=0x7fad2c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:38.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.016+0000 7fad3affd700 1 -- 172.21.15.26:0/1861144267 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fad3c0527a0 con 0x7fad30004d50 2023-09-28T00:15:38.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.207+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad44064050 con 0x7fad30004d50 2023-09-28T00:15:38.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.208+0000 7fad3affd700 1 -- 172.21.15.26:0/1861144267 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad3c055dc0 con 0x7fad30004d50 2023-09-28T00:15:38.209 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-09-28T00:15:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad24067330 msgr2=0x7fad240697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad24067330 0x7fad240697e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fad2c0015a0 tx=0x7fad2c009040 comp rx=0 tx=0).stop 2023-09-28T00:15:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 msgr2=0x7fad441526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad441526b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009fd0 tx=0x7fad3c00b040 comp rx=0 tx=0).stop 2023-09-28T00:15:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 shutdown_connections 2023-09-28T00:15:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fad24067330 0x7fad240697e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fad44156ec0 0x7fad44157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad30004d50 0x7fad441526b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 --2- 172.21.15.26:0/1861144267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fad440c5440 0x7fad440c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 >> 172.21.15.26:0/1861144267 conn(0x7fad44067630 msgr2=0x7fad44069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 shutdown_connections 2023-09-28T00:15:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.209+0000 7fad493fa700 1 -- 172.21.15.26:0/1861144267 wait complete. 2023-09-28T00:15:38.223 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-28T00:15:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.343+0000 7f87015c0700 1 Processor -- start 2023-09-28T00:15:38.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.343+0000 7f87015c0700 1 -- start start 2023-09-28T00:15:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f87015c0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86fc0b0900 0x7f86fc0b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f87015c0700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86fc0b3960 con 0x7f86fc142b90 2023-09-28T00:15:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f87015c0700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86fc0b0da0 con 0x7f86fc15d710 2023-09-28T00:15:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f87015c0700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86fc0cc9b0 con 0x7f86fc0b0900 2023-09-28T00:15:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f86fa7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86fc0b0900 0x7f86fc0b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f86fb7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f86fc142b90 0x7f86fc142f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44038/0 (socket says 172.21.15.26:44038) 2023-09-28T00:15:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f86fb7fe700 1 -- 172.21.15.26:0/65802857 learned_addr learned my addr 172.21.15.26:0/65802857 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f86fa7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86fc0b0900 0x7f86fc0b5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46768/0 (socket says 172.21.15.26:46768) 2023-09-28T00:15:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f86fa7fc700 1 -- 172.21.15.26:0/65802857 >> v1:172.21.15.190:6789/0 conn(0x7f86fc15d710 legacy=0x7f86fc15dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f86fa7fc700 1 -- 172.21.15.26:0/65802857 >> v1:172.21.15.26:6789/0 conn(0x7f86fc142b90 legacy=0x7f86fc142f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f86fa7fc700 1 -- 172.21.15.26:0/65802857 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0ccc90 con 0x7f86fc0b0900 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.344+0000 7f86fa7fc700 1 --2- 172.21.15.26:0/65802857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 0x7f86fc0b5ea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86e40098e0 tx=0x7f86e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec339bc42fa41713 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f86f9ffb700 1 -- 172.21.15.26:0/65802857 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4009e80 con 0x7f86fc0b0900 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f86f9ffb700 1 -- 172.21.15.26:0/65802857 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e400b860 con 0x7f86fc0b0900 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f86f9ffb700 1 -- 172.21.15.26:0/65802857 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e400bbe0 con 0x7f86fc0b0900 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f87015c0700 1 -- 172.21.15.26:0/65802857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 msgr2=0x7f86fc0b5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f87015c0700 1 --2- 172.21.15.26:0/65802857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 0x7f86fc0b5ea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f86e40098e0 tx=0x7f86e40091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f87015c0700 1 -- 172.21.15.26:0/65802857 shutdown_connections 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f87015c0700 1 --2- 172.21.15.26:0/65802857 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 0x7f86fc0b5ea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f87015c0700 1 -- 172.21.15.26:0/65802857 >> 172.21.15.26:0/65802857 conn(0x7f86fc0d0fd0 msgr2=0x7f86fc0ccfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:38.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f87015c0700 1 -- 172.21.15.26:0/65802857 shutdown_connections 2023-09-28T00:15:38.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.345+0000 7f87015c0700 1 -- 172.21.15.26:0/65802857 wait complete. 2023-09-28T00:15:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.346+0000 7f87015c0700 1 Processor -- start 2023-09-28T00:15:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.346+0000 7f87015c0700 1 -- start start 2023-09-28T00:15:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f87015c0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 0x7f86fc159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f87015c0700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc142b90 0x7f86fc169df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f87015c0700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc15d710 0x7f86fc16a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f87015c0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0c52f0 con 0x7f86fc0b0900 2023-09-28T00:15:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f87015c0700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0c58b0 con 0x7f86fc142b90 2023-09-28T00:15:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f87015c0700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc16a920 con 0x7f86fc15d710 2023-09-28T00:15:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f86faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 0x7f86fc159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f86faffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 0x7f86fc159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46772/0 (socket says 172.21.15.26:46772) 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f86faffd700 1 -- 172.21.15.26:0/3876102303 learned_addr learned my addr 172.21.15.26:0/3876102303 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f86fa7fc700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc142b90 0x7f86fc169df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.347+0000 7f86fb7fe700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc15d710 0x7f86fc16a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86faffd700 1 -- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc15d710 msgr2=0x7f86fc16a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86faffd700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc15d710 0x7f86fc16a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86faffd700 1 -- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc142b90 msgr2=0x7f86fc169df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86faffd700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc142b90 0x7f86fc169df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86faffd700 1 -- 172.21.15.26:0/3876102303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e4009420 con 0x7f86fc0b0900 2023-09-28T00:15:38.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86fb7fe700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc15d710 0x7f86fc16a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86faffd700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 0x7f86fc159220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86f400c5c0 tx=0x7f86f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86f2ffd700 1 -- 172.21.15.26:0/3876102303 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4011590 con 0x7f86fc0b0900 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86f2ffd700 1 -- 172.21.15.26:0/3876102303 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f4011710 con 0x7f86fc0b0900 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc16ac00 con 0x7f86fc0b0900 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f86f2ffd700 1 -- 172.21.15.26:0/3876102303 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4011ad0 con 0x7f86fc0b0900 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.348+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc1405a0 con 0x7f86fc0b0900 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.349+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc04c3c0 con 0x7f86fc0b0900 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.350+0000 7f86f2ffd700 1 -- 172.21.15.26:0/3876102303 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f86f401b3b0 con 0x7f86fc0b0900 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.350+0000 7f86f2ffd700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f86dc067330 0x7f86dc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.350+0000 7f86f2ffd700 1 -- 172.21.15.26:0/3876102303 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f86f40840b0 con 0x7f86fc0b0900 2023-09-28T00:15:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.350+0000 7f86fa7fc700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f86dc067330 0x7f86dc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.351+0000 7f86fa7fc700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f86dc067330 0x7f86dc0697e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86e40093f0 tx=0x7f86e4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.354+0000 7f86f2ffd700 1 -- 172.21.15.26:0/3876102303 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f86f4050fb0 con 0x7f86fc0b0900 2023-09-28T00:15:38.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.547+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86fc159cc0 con 0x7f86fc0b0900 2023-09-28T00:15:38.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.547+0000 7f86f2ffd700 1 -- 172.21.15.26:0/3876102303 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86f40545d0 con 0x7f86fc0b0900 2023-09-28T00:15:38.549 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-09-28T00:15:38.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.549+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f86dc067330 msgr2=0x7f86dc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.549+0000 7f87015c0700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f86dc067330 0x7f86dc0697e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f86e40093f0 tx=0x7f86e4017000 comp rx=0 tx=0).stop 2023-09-28T00:15:38.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.549+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 msgr2=0x7f86fc159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.549+0000 7f87015c0700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 0x7f86fc159220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f86f400c5c0 tx=0x7f86f400c8d0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.550+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 shutdown_connections 2023-09-28T00:15:38.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.550+0000 7f87015c0700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f86dc067330 0x7f86dc0697e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.550+0000 7f87015c0700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86fc15d710 0x7f86fc16a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.550+0000 7f87015c0700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc0b0900 0x7f86fc159220 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.550+0000 7f87015c0700 1 --2- 172.21.15.26:0/3876102303 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86fc142b90 0x7f86fc169df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.550+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 >> 172.21.15.26:0/3876102303 conn(0x7f86fc0d0fd0 msgr2=0x7f86fc067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:38.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.550+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 shutdown_connections 2023-09-28T00:15:38.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.550+0000 7f87015c0700 1 -- 172.21.15.26:0/3876102303 wait complete. 2023-09-28T00:15:38.563 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-28T00:15:38.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.683+0000 7fb18b6f6700 1 Processor -- start 2023-09-28T00:15:38.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.683+0000 7fb18b6f6700 1 -- start start 2023-09-28T00:15:38.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb18b6f6700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb184159500 0x7fb1841598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb18b6f6700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb1840b3fd0 0x7fb18415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb18b6f6700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18415dd20 con 0x7fb18415d8e0 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb18b6f6700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1840b1110 con 0x7fb1840b3fd0 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb18b6f6700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1840b13b0 con 0x7fb184159500 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb189c93700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb18415d8e0 0x7fb1840cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44048/0 (socket says 172.21.15.26:44048) 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb189c93700 1 -- 172.21.15.26:0/2543380835 learned_addr learned my addr 172.21.15.26:0/2543380835 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb189492700 1 --2- 172.21.15.26:0/2543380835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb184159500 0x7fb1841598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb188c91700 1 --2- 172.21.15.26:0/2543380835 >> v2:172.21.15.190:3300/0 conn(0x7fb1840b3fd0 0x7fb18415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb183fff700 1 -- 172.21.15.26:0/2543380835 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765893275 0 0) 0x7fb18415dd20 con 0x7fb18415d8e0 2023-09-28T00:15:38.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb183fff700 1 -- 172.21.15.26:0/2543380835 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb16c003570 con 0x7fb18415d8e0 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb188c91700 1 -- 172.21.15.26:0/2543380835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb184159500 msgr2=0x7fb1841598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb188c91700 1 --2- 172.21.15.26:0/2543380835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb184159500 0x7fb1841598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb188c91700 1 -- 172.21.15.26:0/2543380835 >> v1:172.21.15.26:6789/0 conn(0x7fb18415d8e0 legacy=0x7fb1840cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb188c91700 1 -- 172.21.15.26:0/2543380835 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840b1690 con 0x7fb1840b3fd0 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb189492700 1 --2- 172.21.15.26:0/2543380835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb184159500 0x7fb1841598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.684+0000 7fb188c91700 1 --2- 172.21.15.26:0/2543380835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 0x7fb18415d3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1780098e0 tx=0x7fb1780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d6cd7d03411889 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb183fff700 1 -- 172.21.15.26:0/2543380835 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178011630 con 0x7fb1840b3fd0 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb183fff700 1 -- 172.21.15.26:0/2543380835 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb178011790 con 0x7fb1840b3fd0 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb183fff700 1 -- 172.21.15.26:0/2543380835 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178011b30 con 0x7fb1840b3fd0 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb18b6f6700 1 -- 172.21.15.26:0/2543380835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 msgr2=0x7fb18415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb18b6f6700 1 --2- 172.21.15.26:0/2543380835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 0x7fb18415d3a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1780098e0 tx=0x7fb1780091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb18b6f6700 1 -- 172.21.15.26:0/2543380835 shutdown_connections 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb18b6f6700 1 --2- 172.21.15.26:0/2543380835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb184159500 0x7fb1841598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb18b6f6700 1 --2- 172.21.15.26:0/2543380835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 0x7fb18415d3a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb18b6f6700 1 -- 172.21.15.26:0/2543380835 >> 172.21.15.26:0/2543380835 conn(0x7fb184067630 msgr2=0x7fb184069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb18b6f6700 1 -- 172.21.15.26:0/2543380835 shutdown_connections 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.685+0000 7fb18b6f6700 1 -- 172.21.15.26:0/2543380835 wait complete. 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.686+0000 7fb18b6f6700 1 Processor -- start 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.686+0000 7fb18b6f6700 1 -- start start 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.687+0000 7fb18b6f6700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 0x7fb18415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.687+0000 7fb18b6f6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184159500 0x7fb18416cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.687+0000 7fb18b6f6700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb18415d8e0 0x7fb18416aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.687+0000 7fb18b6f6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18416d4b0 con 0x7fb184159500 2023-09-28T00:15:38.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.687+0000 7fb18b6f6700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18416b030 con 0x7fb1840b3fd0 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.687+0000 7fb18b6f6700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb184169ee0 con 0x7fb18415d8e0 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.687+0000 7fb188c91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184159500 0x7fb18416cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.687+0000 7fb188c91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184159500 0x7fb18416cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46788/0 (socket says 172.21.15.26:46788) 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.687+0000 7fb188c91700 1 -- 172.21.15.26:0/1634698290 learned_addr learned my addr 172.21.15.26:0/1634698290 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb189492700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 0x7fb18415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb189c93700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb18415d8e0 0x7fb18416aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb188c91700 1 -- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb18415d8e0 msgr2=0x7fb18416aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb188c91700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb18415d8e0 0x7fb18416aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb188c91700 1 -- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 msgr2=0x7fb18415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb188c91700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 0x7fb18415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb188c91700 1 -- 172.21.15.26:0/1634698290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c009a20 con 0x7fb184159500 2023-09-28T00:15:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb189492700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 0x7fb18415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb188c91700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184159500 0x7fb18416cf70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb18415deb0 tx=0x7fb178017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb1817fa700 1 -- 172.21.15.26:0/1634698290 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178011b10 con 0x7fb184159500 2023-09-28T00:15:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb1817fa700 1 -- 172.21.15.26:0/1634698290 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1780253f0 con 0x7fb184159500 2023-09-28T00:15:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb1817fa700 1 -- 172.21.15.26:0/1634698290 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178025790 con 0x7fb184159500 2023-09-28T00:15:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb178009420 con 0x7fb184159500 2023-09-28T00:15:38.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.688+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18415bf70 con 0x7fb184159500 2023-09-28T00:15:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.689+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1841568e0 con 0x7fb184159500 2023-09-28T00:15:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.689+0000 7fb1817fa700 1 -- 172.21.15.26:0/1634698290 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb178025b80 con 0x7fb184159500 2023-09-28T00:15:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.690+0000 7fb1817fa700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb170067330 0x7fb1700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.690+0000 7fb1817fa700 1 -- 172.21.15.26:0/1634698290 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb178086490 con 0x7fb184159500 2023-09-28T00:15:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.690+0000 7fb189492700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb170067330 0x7fb1700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:38.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.690+0000 7fb189492700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb170067330 0x7fb1700697e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0099f0 tx=0x7fb17c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:38.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.694+0000 7fb1817fa700 1 -- 172.21.15.26:0/1634698290 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb178053390 con 0x7fb184159500 2023-09-28T00:15:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.887+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb184064050 con 0x7fb184159500 2023-09-28T00:15:38.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.887+0000 7fb1817fa700 1 -- 172.21.15.26:0/1634698290 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1780569b0 con 0x7fb184159500 2023-09-28T00:15:38.888 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-09-28T00:15:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb170067330 msgr2=0x7fb1700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb170067330 0x7fb1700697e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0099f0 tx=0x7fb17c00b040 comp rx=0 tx=0).stop 2023-09-28T00:15:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184159500 msgr2=0x7fb18416cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184159500 0x7fb18416cf70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb18415deb0 tx=0x7fb178017000 comp rx=0 tx=0).stop 2023-09-28T00:15:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 shutdown_connections 2023-09-28T00:15:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb170067330 0x7fb1700697e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb18415d8e0 0x7fb18416aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb1840b3fd0 0x7fb18415b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 --2- 172.21.15.26:0/1634698290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb184159500 0x7fb18416cf70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 >> 172.21.15.26:0/1634698290 conn(0x7fb184067630 msgr2=0x7fb1840cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 shutdown_connections 2023-09-28T00:15:38.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:38.889+0000 7fb18b6f6700 1 -- 172.21.15.26:0/1634698290 wait complete. 2023-09-28T00:15:38.903 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:15:39.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.020+0000 7fb182234700 1 Processor -- start 2023-09-28T00:15:39.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.020+0000 7fb182234700 1 -- start start 2023-09-28T00:15:39.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.020+0000 7fb182234700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb17c0add70 0x7fb17c0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.020+0000 7fb182234700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c1580d0 con 0x7fb17c0b4060 2023-09-28T00:15:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.020+0000 7fb182234700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17c0ae6d0 con 0x7fb17c157570 2023-09-28T00:15:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.020+0000 7fb182234700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17c158c70 con 0x7fb17c0add70 2023-09-28T00:15:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.020+0000 7fb17affd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb17c0b4060 0x7fb17c158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44062/0 (socket says 172.21.15.26:44062) 2023-09-28T00:15:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17affd700 1 -- 172.21.15.26:0/2315435166 learned_addr learned my addr 172.21.15.26:0/2315435166 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17bfff700 1 --2- 172.21.15.26:0/2315435166 >> v2:172.21.15.190:3300/0 conn(0x7fb17c0add70 0x7fb17c0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510989581 0 0) 0x7fb17c1580d0 con 0x7fb17c0b4060 2023-09-28T00:15:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb164003570 con 0x7fb17c0b4060 2023-09-28T00:15:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2497590145 0 0) 0x7fb164003570 con 0x7fb17c0b4060 2023-09-28T00:15:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 >> v2:172.21.15.190:3300/0 conn(0x7fb17c0add70 msgr2=0x7fb17c0ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 --2- 172.21.15.26:0/2315435166 >> v2:172.21.15.190:3300/0 conn(0x7fb17c0add70 0x7fb17c0ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 >> v1:172.21.15.190:6789/0 conn(0x7fb17c157570 legacy=0x7fb17c15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c15ba40 con 0x7fb17c0b4060 2023-09-28T00:15:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fb170001470 con 0x7fb17c0b4060 2023-09-28T00:15:39.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 >> v1:172.21.15.26:6789/0 conn(0x7fb17c0b4060 legacy=0x7fb17c158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb164003a60 0x7fb164003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb164004810 0x7fb164004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb16400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c158c70 con 0x7fb1640051c0 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400c050 con 0x7fb164003a60 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16400c210 con 0x7fb164004810 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17bfff700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb16400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17b7fe700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb164003a60 0x7fb164003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.021+0000 7fb17affd700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb164004810 0x7fb164004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17bfff700 1 -- 172.21.15.26:0/2315435166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb164004810 msgr2=0x7fb164004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17bfff700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb164004810 0x7fb164004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17bfff700 1 -- 172.21.15.26:0/2315435166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb164003a60 msgr2=0x7fb164003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:39.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17bfff700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb164003a60 0x7fb164003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17bfff700 1 -- 172.21.15.26:0/2315435166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164003570 con 0x7fb1640051c0 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17affd700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb164004810 0x7fb164004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17bfff700 1 -- 172.21.15.26:0/2315435166 reap_dead start 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17bfff700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb16400ba60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb174009c00 tx=0x7fb1740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220645b28b7b234c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400e710 con 0x7fb1640051c0 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400e890 con 0x7fb1640051c0 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb17a7fc700 1 -- 172.21.15.26:0/2315435166 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400ec50 con 0x7fb1640051c0 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb182234700 1 -- 172.21.15.26:0/2315435166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 msgr2=0x7fb16400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb182234700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb16400ba60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb174009c00 tx=0x7fb1740091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb182234700 1 -- 172.21.15.26:0/2315435166 shutdown_connections 2023-09-28T00:15:39.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb182234700 1 --2- 172.21.15.26:0/2315435166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb16400ba60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.022+0000 7fb182234700 1 -- 172.21.15.26:0/2315435166 >> 172.21.15.26:0/2315435166 conn(0x7fb17c067630 msgr2=0x7fb17c067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.023+0000 7fb182234700 1 -- 172.21.15.26:0/2315435166 shutdown_connections 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.023+0000 7fb182234700 1 -- 172.21.15.26:0/2315435166 wait complete. 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.024+0000 7fb182234700 1 Processor -- start 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.024+0000 7fb182234700 1 -- start start 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb182234700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb17c0c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb182234700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb17c1560e0 0x7fb17c167c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb182234700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb17c168140 0x7fb17c0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb182234700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0ad380 con 0x7fb1640051c0 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb182234700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c168ba0 con 0x7fb17c1560e0 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb182234700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17c0c5950 con 0x7fb17c168140 2023-09-28T00:15:39.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb17c0c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb17c0c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46802/0 (socket says 172.21.15.26:46802) 2023-09-28T00:15:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17b7fe700 1 -- 172.21.15.26:0/725641159 learned_addr learned my addr 172.21.15.26:0/725641159 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17affd700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb17c1560e0 0x7fb17c167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17bfff700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb17c168140 0x7fb17c0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17b7fe700 1 -- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb17c168140 msgr2=0x7fb17c0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17b7fe700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb17c168140 0x7fb17c0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17b7fe700 1 -- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb17c1560e0 msgr2=0x7fb17c167c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17b7fe700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb17c1560e0 0x7fb17c167c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17b7fe700 1 -- 172.21.15.26:0/725641159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c0c2490 con 0x7fb1640051c0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb17b7fe700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb17c0c1f50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00eb90 tx=0x7fb16c0016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb1637fe700 1 -- 172.21.15.26:0/725641159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c004100 con 0x7fb1640051c0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb1637fe700 1 -- 172.21.15.26:0/725641159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c00c760 con 0x7fb1640051c0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17c1685e0 con 0x7fb1640051c0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb1637fe700 1 -- 172.21.15.26:0/725641159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00cb00 con 0x7fb1640051c0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.025+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17c0c55e0 con 0x7fb1640051c0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.026+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17c064050 con 0x7fb1640051c0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.027+0000 7fb1637fe700 1 -- 172.21.15.26:0/725641159 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb16c01f460 con 0x7fb1640051c0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.027+0000 7fb1637fe700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb168067330 0x7fb1680697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.027+0000 7fb1637fe700 1 -- 172.21.15.26:0/725641159 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb16c085200 con 0x7fb1640051c0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.027+0000 7fb17affd700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb168067330 0x7fb1680697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.028+0000 7fb17affd700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb168067330 0x7fb1680697e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0ca680 tx=0x7fb170007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:39.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.031+0000 7fb1637fe700 1 -- 172.21.15.26:0/725641159 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb16c052100 con 0x7fb1640051c0 2023-09-28T00:15:39.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.268+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb17c0b3070 con 0x7fb1640051c0 2023-09-28T00:15:39.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.269+0000 7fb1637fe700 1 -- 172.21.15.26:0/725641159 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fb16c055720 con 0x7fb1640051c0 2023-09-28T00:15:39.270 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:39.270 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1101672577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1101672577},{"type":"v1","addr":"172.21.15.190:6836","nonce":1101672577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3243251915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3243251915},{"type":"v1","addr":"172.21.15.26:6834","nonce":3243251915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/501056069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":501056069},{"type":"v1","addr":"172.21.15.26:6835","nonce":501056069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:15:29.372185+0000","modified":"2023-09-28T00:15:32.384937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/3098279304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3098279304},{"type":"v1","addr":"172.21.15.190:6837","nonce":3098279304}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:15:39.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb168067330 msgr2=0x7fb1680697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb168067330 0x7fb1680697e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0ca680 tx=0x7fb170007040 comp rx=0 tx=0).stop 2023-09-28T00:15:39.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 msgr2=0x7fb17c0c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb17c0c1f50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb16c00eb90 tx=0x7fb16c0016e0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 shutdown_connections 2023-09-28T00:15:39.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb168067330 0x7fb1680697e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb17c168140 0x7fb17c0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640051c0 0x7fb17c0c1f50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 --2- 172.21.15.26:0/725641159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb17c1560e0 0x7fb17c167c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 >> 172.21.15.26:0/725641159 conn(0x7fb17c067630 msgr2=0x7fb17c158560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:39.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 shutdown_connections 2023-09-28T00:15:39.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.271+0000 7fb182234700 1 -- 172.21.15.26:0/725641159 wait complete. 2023-09-28T00:15:39.273 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-09-28T00:15:39.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:39.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.402+0000 7f9fec86c700 1 Processor -- start 2023-09-28T00:15:39.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.402+0000 7f9fec86c700 1 -- start start 2023-09-28T00:15:39.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fec86c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d560 0x7f9fe80d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fec86c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fe81591b0 0x7f9fe8159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fec86c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80b2ad0 con 0x7f9fe815d930 2023-09-28T00:15:39.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fec86c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80b4160 con 0x7f9fe81591b0 2023-09-28T00:15:39.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fec86c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8159b70 con 0x7f9fe815d560 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fe81591b0 0x7f9fe8159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe6d9d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9fe81591b0 0x7f9fe8159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46812/0 (socket says 172.21.15.26:46812) 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe6d9d700 1 -- 172.21.15.26:0/432048870 learned_addr learned my addr 172.21.15.26:0/432048870 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe659c700 1 --2- 172.21.15.26:0/432048870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d560 0x7f9fe80d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe6d9d700 1 -- 172.21.15.26:0/432048870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d560 msgr2=0x7f9fe80d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe6d9d700 1 --2- 172.21.15.26:0/432048870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d560 0x7f9fe80d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe6d9d700 1 -- 172.21.15.26:0/432048870 >> v1:172.21.15.190:6789/0 conn(0x7f9fe815d930 legacy=0x7f9fe80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe6d9d700 1 -- 172.21.15.26:0/432048870 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe80b2230 con 0x7f9fe81591b0 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe6d9d700 1 --2- 172.21.15.26:0/432048870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 0x7f9fe8159630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009f20 tx=0x7f9fd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4205cc2a0d51dad server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe559a700 1 -- 172.21.15.26:0/432048870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd800e070 con 0x7f9fe81591b0 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe559a700 1 -- 172.21.15.26:0/432048870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd800ba80 con 0x7f9fe81591b0 2023-09-28T00:15:39.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.403+0000 7f9fe559a700 1 -- 172.21.15.26:0/432048870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd80092e0 con 0x7f9fe81591b0 2023-09-28T00:15:39.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.404+0000 7f9fec86c700 1 -- 172.21.15.26:0/432048870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 msgr2=0x7f9fe8159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.404+0000 7f9fec86c700 1 --2- 172.21.15.26:0/432048870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 0x7f9fe8159630 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9fd8009f20 tx=0x7f9fd8009840 comp rx=0 tx=0).stop 2023-09-28T00:15:39.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.404+0000 7f9fec86c700 1 -- 172.21.15.26:0/432048870 shutdown_connections 2023-09-28T00:15:39.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.404+0000 7f9fec86c700 1 --2- 172.21.15.26:0/432048870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 0x7f9fe8159630 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.404+0000 7f9fec86c700 1 --2- 172.21.15.26:0/432048870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d560 0x7f9fe80d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.404+0000 7f9fec86c700 1 -- 172.21.15.26:0/432048870 >> 172.21.15.26:0/432048870 conn(0x7f9fe80d1180 msgr2=0x7f9fe8069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:39.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.404+0000 7f9fec86c700 1 -- 172.21.15.26:0/432048870 shutdown_connections 2023-09-28T00:15:39.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.404+0000 7f9fec86c700 1 -- 172.21.15.26:0/432048870 wait complete. 2023-09-28T00:15:39.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.405+0000 7f9fec86c700 1 Processor -- start 2023-09-28T00:15:39.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.405+0000 7f9fec86c700 1 -- start start 2023-09-28T00:15:39.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fec86c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 0x7f9fe8154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fec86c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fe815d560 0x7f9fe815ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fec86c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d930 0x7f9fe8144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fec86c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8144650 con 0x7f9fe81591b0 2023-09-28T00:15:39.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fec86c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe815bc30 con 0x7f9fe815d560 2023-09-28T00:15:39.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fec86c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe815bf10 con 0x7f9fe815d930 2023-09-28T00:15:39.410 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 0x7f9fe8154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 0x7f9fe8154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46828/0 (socket says 172.21.15.26:46828) 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe659c700 1 -- 172.21.15.26:0/186225695 learned_addr learned my addr 172.21.15.26:0/186225695 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe6d9d700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d930 0x7f9fe8144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe5d9b700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fe815d560 0x7f9fe815ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe659c700 1 -- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d930 msgr2=0x7f9fe8144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe659c700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d930 0x7f9fe8144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe659c700 1 -- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fe815d560 msgr2=0x7f9fe815ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe659c700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fe815d560 0x7f9fe815ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe659c700 1 -- 172.21.15.26:0/186225695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd8009ae0 con 0x7f9fe81591b0 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe6d9d700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d930 0x7f9fe8144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe5d9b700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fe815d560 0x7f9fe815ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:39.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.406+0000 7f9fe659c700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 0x7f9fe8154a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000d890 tx=0x7f9fe0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.407+0000 7f9fde7fc700 1 -- 172.21.15.26:0/186225695 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000b600 con 0x7f9fe81591b0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.407+0000 7f9fde7fc700 1 -- 172.21.15.26:0/186225695 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000b760 con 0x7f9fe81591b0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.407+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe815c1f0 con 0x7f9fe81591b0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.407+0000 7f9fde7fc700 1 -- 172.21.15.26:0/186225695 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000bae0 con 0x7f9fe81591b0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.407+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe815c7b0 con 0x7f9fe81591b0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.407+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe815cb20 con 0x7f9fe81591b0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.408+0000 7f9fde7fc700 1 -- 172.21.15.26:0/186225695 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9fe001e460 con 0x7f9fe81591b0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.408+0000 7f9fde7fc700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9fc8067330 0x7f9fc80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.408+0000 7f9fde7fc700 1 -- 172.21.15.26:0/186225695 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9fe0085260 con 0x7f9fe81591b0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.409+0000 7f9fe5d9b700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9fc8067330 0x7f9fc80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.409+0000 7f9fe5d9b700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9fc8067330 0x7f9fc80697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0007fd0 tx=0x7f9fd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:39.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.413+0000 7f9fde7fc700 1 -- 172.21.15.26:0/186225695 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f9fe0052160 con 0x7f9fe81591b0 2023-09-28T00:15:39.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.609+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fe8064050 con 0x7f9fe81591b0 2023-09-28T00:15:39.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.609+0000 7f9fde7fc700 1 -- 172.21.15.26:0/186225695 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f9fe0055780 con 0x7f9fe81591b0 2023-09-28T00:15:39.611 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:39.611 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:30.373905+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:39.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9fc8067330 msgr2=0x7f9fc80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9fc8067330 0x7f9fc80697e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0007fd0 tx=0x7f9fd0009040 comp rx=0 tx=0).stop 2023-09-28T00:15:39.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 msgr2=0x7f9fe8154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 0x7f9fe8154a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fe000d890 tx=0x7f9fe0008040 comp rx=0 tx=0).stop 2023-09-28T00:15:39.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 shutdown_connections 2023-09-28T00:15:39.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f9fc8067330 0x7f9fc80697e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9fe815d930 0x7f9fe8144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9fe81591b0 0x7f9fe8154a70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 --2- 172.21.15.26:0/186225695 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9fe815d560 0x7f9fe815ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 >> 172.21.15.26:0/186225695 conn(0x7f9fe80d1180 msgr2=0x7f9fe80b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:39.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 shutdown_connections 2023-09-28T00:15:39.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.612+0000 7f9fec86c700 1 -- 172.21.15.26:0/186225695 wait complete. 2023-09-28T00:15:39.625 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-28T00:15:15.721561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-28T00:15:22.381112+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-28T00:15:27.106757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-28T00:15:28.347923+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-09-28T00:15:39.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-28T00:15:39.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.746+0000 7fa891d01700 1 Processor -- start 2023-09-28T00:15:39.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.746+0000 7fa891d01700 1 -- start start 2023-09-28T00:15:39.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa891d01700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa891d01700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa88c15d8e0 0x7fa88c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa891d01700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c15dd20 con 0x7fa88c159500 2023-09-28T00:15:39.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa891d01700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa88c0b1110 con 0x7fa88c15d8e0 2023-09-28T00:15:39.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa891d01700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0b13b0 con 0x7fa88c1598d0 2023-09-28T00:15:39.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa88affd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa88bfff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa88c15d8e0 0x7fa88c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa88bfff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa88c15d8e0 0x7fa88c0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:38536/0 (socket says 172.21.15.26:38536) 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa88affd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34884/0 (socket says 172.21.15.26:34884) 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa88bfff700 1 -- 172.21.15.26:0/1102693263 learned_addr learned my addr 172.21.15.26:0/1102693263 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.747+0000 7fa88b7fe700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fa88c159500 0x7fa88c0b3fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:48744/0 (socket says 172.21.15.26:48744) 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88affd700 1 -- 172.21.15.26:0/1102693263 >> v2:172.21.15.190:3300/0 conn(0x7fa88c15d8e0 msgr2=0x7fa88c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88affd700 1 --2- 172.21.15.26:0/1102693263 >> v2:172.21.15.190:3300/0 conn(0x7fa88c15d8e0 0x7fa88c0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88affd700 1 -- 172.21.15.26:0/1102693263 >> v1:172.21.15.190:6789/0 conn(0x7fa88c159500 legacy=0x7fa88c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88affd700 1 -- 172.21.15.26:0/1102693263 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0b1690 con 0x7fa88c1598d0 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88a7fc700 1 -- 172.21.15.26:0/1102693263 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132990213 0 0) 0x7fa88c15dd20 con 0x7fa88c159500 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88bfff700 1 --2- 172.21.15.26:0/1102693263 >> v2:172.21.15.190:3300/0 conn(0x7fa88c15d8e0 0x7fa88c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:39.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88affd700 1 --2- 172.21.15.26:0/1102693263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15d3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa8800098e0 tx=0x7fa8800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b461e8b43e6467e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:39.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88a7fc700 1 -- 172.21.15.26:0/1102693263 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000b640 con 0x7fa88c1598d0 2023-09-28T00:15:39.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88a7fc700 1 -- 172.21.15.26:0/1102693263 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000b7a0 con 0x7fa88c1598d0 2023-09-28T00:15:39.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.748+0000 7fa88a7fc700 1 -- 172.21.15.26:0/1102693263 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000bb40 con 0x7fa88c1598d0 2023-09-28T00:15:39.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.749+0000 7fa891d01700 1 -- 172.21.15.26:0/1102693263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 msgr2=0x7fa88c15d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.749+0000 7fa891d01700 1 --2- 172.21.15.26:0/1102693263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15d3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa8800098e0 tx=0x7fa8800091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.749+0000 7fa891d01700 1 -- 172.21.15.26:0/1102693263 shutdown_connections 2023-09-28T00:15:39.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.749+0000 7fa891d01700 1 --2- 172.21.15.26:0/1102693263 >> v2:172.21.15.190:3300/0 conn(0x7fa88c15d8e0 0x7fa88c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.749+0000 7fa891d01700 1 --2- 172.21.15.26:0/1102693263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15d3a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.749+0000 7fa891d01700 1 -- 172.21.15.26:0/1102693263 >> 172.21.15.26:0/1102693263 conn(0x7fa88c067630 msgr2=0x7fa88c069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:39.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.749+0000 7fa891d01700 1 -- 172.21.15.26:0/1102693263 shutdown_connections 2023-09-28T00:15:39.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.749+0000 7fa891d01700 1 -- 172.21.15.26:0/1102693263 wait complete. 2023-09-28T00:15:39.755 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.750+0000 7fa891d01700 1 Processor -- start 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.750+0000 7fa891d01700 1 -- start start 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa891d01700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88c159500 0x7fa88c16dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa891d01700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa891d01700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c15d8e0 0x7fa88c14a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa891d01700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c16e420 con 0x7fa88c15d8e0 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa891d01700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c14cfe0 con 0x7fa88c159500 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa891d01700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c14d2c0 con 0x7fa88c1598d0 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c15d8e0 0x7fa88c14a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c15d8e0 0x7fa88c14a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46834/0 (socket says 172.21.15.26:46834) 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88bfff700 1 -- 172.21.15.26:0/3683695300 learned_addr learned my addr 172.21.15.26:0/3683695300 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:39.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88b7fe700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88c159500 0x7fa88c16dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88affd700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88bfff700 1 -- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 msgr2=0x7fa88c15f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88bfff700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88bfff700 1 -- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88c159500 msgr2=0x7fa88c16dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88bfff700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88c159500 0x7fa88c16dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88bfff700 1 -- 172.21.15.26:0/3683695300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884009ae0 con 0x7fa88c15d8e0 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa88bfff700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c15d8e0 0x7fa88c14a2b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa884009f30 tx=0x7fa88400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa8737fe700 1 -- 172.21.15.26:0/3683695300 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884018070 con 0x7fa88c15d8e0 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa8737fe700 1 -- 172.21.15.26:0/3683695300 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88400f040 con 0x7fa88c15d8e0 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa880009420 con 0x7fa88c15d8e0 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.751+0000 7fa8737fe700 1 -- 172.21.15.26:0/3683695300 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88400cb70 con 0x7fa88c15d8e0 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.752+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c14d880 con 0x7fa88c15d8e0 2023-09-28T00:15:39.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.752+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c14c900 con 0x7fa88c15d8e0 2023-09-28T00:15:39.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.753+0000 7fa8737fe700 1 -- 172.21.15.26:0/3683695300 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa884003020 con 0x7fa88c15d8e0 2023-09-28T00:15:39.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.753+0000 7fa8737fe700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa878067330 0x7fa8780697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:39.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.753+0000 7fa8737fe700 1 -- 172.21.15.26:0/3683695300 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa884084a70 con 0x7fa88c15d8e0 2023-09-28T00:15:39.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.753+0000 7fa88b7fe700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa878067330 0x7fa8780697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:39.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.754+0000 7fa88b7fe700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa878067330 0x7fa8780697e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa87c007fd0 tx=0x7fa87c007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:39.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.758+0000 7fa8737fe700 1 -- 172.21.15.26:0/3683695300 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa884051970 con 0x7fa88c15d8e0 2023-09-28T00:15:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.951+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa88c064050 con 0x7fa88c15d8e0 2023-09-28T00:15:39.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.952+0000 7fa8737fe700 1 -- 172.21.15.26:0/3683695300 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa884054f90 con 0x7fa88c15d8e0 2023-09-28T00:15:39.953 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-09-28T00:15:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa878067330 msgr2=0x7fa8780697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa878067330 0x7fa8780697e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa87c007fd0 tx=0x7fa87c007d30 comp rx=0 tx=0).stop 2023-09-28T00:15:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c15d8e0 msgr2=0x7fa88c14a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c15d8e0 0x7fa88c14a2b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa884009f30 tx=0x7fa88400b040 comp rx=0 tx=0).stop 2023-09-28T00:15:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 shutdown_connections 2023-09-28T00:15:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa878067330 0x7fa8780697e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa88c15d8e0 0x7fa88c14a2b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa88c159500 0x7fa88c16dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 --2- 172.21.15.26:0/3683695300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa88c1598d0 0x7fa88c15f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 >> 172.21.15.26:0/3683695300 conn(0x7fa88c067630 msgr2=0x7fa88c14c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 shutdown_connections 2023-09-28T00:15:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:39.954+0000 7fa891d01700 1 -- 172.21.15.26:0/3683695300 wait complete. 2023-09-28T00:15:39.967 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-28T00:15:40.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.088+0000 7f11459b7700 1 Processor -- start 2023-09-28T00:15:40.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.088+0000 7f11459b7700 1 -- start start 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f11459b7700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1140159500 0x7f11401598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f11459b7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11400b3fd0 0x7f114015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f11459b7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114015d8e0 0x7f11400cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f11459b7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f114015dd20 con 0x7f11400b3fd0 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f11459b7700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400b1110 con 0x7f1140159500 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f11459b7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11400b13b0 con 0x7f114015d8e0 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f113e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11400b3fd0 0x7f114015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f113e7fc700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f11400b3fd0 0x7f114015d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46840/0 (socket says 172.21.15.26:46840) 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f113e7fc700 1 -- 172.21.15.26:0/2810653437 learned_addr learned my addr 172.21.15.26:0/2810653437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:40.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f113f7fe700 1 --2- 172.21.15.26:0/2810653437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114015d8e0 0x7f11400cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.089+0000 7f113effd700 1 --2- 172.21.15.26:0/2810653437 >> v2:172.21.15.190:3300/0 conn(0x7f1140159500 0x7f11401598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f113e7fc700 1 -- 172.21.15.26:0/2810653437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114015d8e0 msgr2=0x7f11400cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f113e7fc700 1 --2- 172.21.15.26:0/2810653437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114015d8e0 0x7f11400cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f113e7fc700 1 -- 172.21.15.26:0/2810653437 >> v2:172.21.15.190:3300/0 conn(0x7f1140159500 msgr2=0x7f11401598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f113e7fc700 1 --2- 172.21.15.26:0/2810653437 >> v2:172.21.15.190:3300/0 conn(0x7f1140159500 0x7f11401598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f113e7fc700 1 -- 172.21.15.26:0/2810653437 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400b1690 con 0x7f11400b3fd0 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f113e7fc700 1 --2- 172.21.15.26:0/2810653437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11400b3fd0 0x7f114015d3a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1140063e00 tx=0x7f1128009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fcaefc60985d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f113dffb700 1 -- 172.21.15.26:0/2810653437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112800b860 con 0x7f11400b3fd0 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f113dffb700 1 -- 172.21.15.26:0/2810653437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112800b9c0 con 0x7f11400b3fd0 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f113dffb700 1 -- 172.21.15.26:0/2810653437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112800bd60 con 0x7f11400b3fd0 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f11459b7700 1 -- 172.21.15.26:0/2810653437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11400b3fd0 msgr2=0x7f114015d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f11459b7700 1 --2- 172.21.15.26:0/2810653437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11400b3fd0 0x7f114015d3a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1140063e00 tx=0x7f1128009250 comp rx=0 tx=0).stop 2023-09-28T00:15:40.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f11459b7700 1 -- 172.21.15.26:0/2810653437 shutdown_connections 2023-09-28T00:15:40.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f11459b7700 1 --2- 172.21.15.26:0/2810653437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f114015d8e0 0x7f11400cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f11459b7700 1 --2- 172.21.15.26:0/2810653437 >> v2:172.21.15.190:3300/0 conn(0x7f1140159500 0x7f11401598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f11459b7700 1 --2- 172.21.15.26:0/2810653437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f11400b3fd0 0x7f114015d3a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f11459b7700 1 -- 172.21.15.26:0/2810653437 >> 172.21.15.26:0/2810653437 conn(0x7f1140067630 msgr2=0x7f1140069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:40.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f11459b7700 1 -- 172.21.15.26:0/2810653437 shutdown_connections 2023-09-28T00:15:40.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.090+0000 7f11459b7700 1 -- 172.21.15.26:0/2810653437 wait complete. 2023-09-28T00:15:40.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f11459b7700 1 Processor -- start 2023-09-28T00:15:40.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f11459b7700 1 -- start start 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f11459b7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11400b3fd0 0x7f114016a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f11459b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1140159500 0x7f11400ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f11459b7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f114015d8e0 0x7f11400b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f11459b7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114015cb10 con 0x7f1140159500 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f11459b7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114016ae30 con 0x7f114015d8e0 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f11459b7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1140159dd0 con 0x7f11400b3fd0 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f113e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1140159500 0x7f11400ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f113e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1140159500 0x7f11400ae560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46842/0 (socket says 172.21.15.26:46842) 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.092+0000 7f113e7fc700 1 -- 172.21.15.26:0/2859915394 learned_addr learned my addr 172.21.15.26:0/2859915394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f113f7fe700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f114015d8e0 0x7f11400b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f113effd700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11400b3fd0 0x7f114016a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f113e7fc700 1 -- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11400b3fd0 msgr2=0x7f114016a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f113e7fc700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11400b3fd0 0x7f114016a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f113e7fc700 1 -- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f114015d8e0 msgr2=0x7f11400b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f113e7fc700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f114015d8e0 0x7f11400b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f113e7fc700 1 -- 172.21.15.26:0/2859915394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11280094f0 con 0x7f1140159500 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f113f7fe700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f114015d8e0 0x7f11400b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f113e7fc700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1140159500 0x7f11400ae560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1140088d00 tx=0x7f1128017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f1136ffd700 1 -- 172.21.15.26:0/2859915394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128024440 con 0x7f1140159500 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f1136ffd700 1 -- 172.21.15.26:0/2859915394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11280245a0 con 0x7f1140159500 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114015a0b0 con 0x7f1140159500 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f1136ffd700 1 -- 172.21.15.26:0/2859915394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128024960 con 0x7f1140159500 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.093+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114015a670 con 0x7f1140159500 2023-09-28T00:15:40.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.094+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1140064050 con 0x7f1140159500 2023-09-28T00:15:40.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.094+0000 7f1136ffd700 1 -- 172.21.15.26:0/2859915394 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f112801a420 con 0x7f1140159500 2023-09-28T00:15:40.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.095+0000 7f1136ffd700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1120067330 0x7f11200697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.095+0000 7f1136ffd700 1 -- 172.21.15.26:0/2859915394 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1128086a70 con 0x7f1140159500 2023-09-28T00:15:40.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.095+0000 7f113effd700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1120067330 0x7f11200697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.095+0000 7f113effd700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1120067330 0x7f11200697e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1138006fd0 tx=0x7f1138008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:40.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.099+0000 7f1136ffd700 1 -- 172.21.15.26:0/2859915394 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1128053970 con 0x7f1140159500 2023-09-28T00:15:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.291+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f11400b1970 con 0x7f1140159500 2023-09-28T00:15:40.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.291+0000 7f1136ffd700 1 -- 172.21.15.26:0/2859915394 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f11280150a0 con 0x7f1140159500 2023-09-28T00:15:40.292 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 8 2023-09-28T00:15:40.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1120067330 msgr2=0x7f11200697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1120067330 0x7f11200697e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1138006fd0 tx=0x7f1138008040 comp rx=0 tx=0).stop 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1140159500 msgr2=0x7f11400ae560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1140159500 0x7f11400ae560 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1140088d00 tx=0x7f1128017000 comp rx=0 tx=0).stop 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 shutdown_connections 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1120067330 0x7f11200697e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f11400b3fd0 0x7f114016a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f114015d8e0 0x7f11400b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 --2- 172.21.15.26:0/2859915394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1140159500 0x7f11400ae560 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 >> 172.21.15.26:0/2859915394 conn(0x7f1140067630 msgr2=0x7f1140069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 shutdown_connections 2023-09-28T00:15:40.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.293+0000 7f11459b7700 1 -- 172.21.15.26:0/2859915394 wait complete. 2023-09-28T00:15:40.306 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-28T00:15:40.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.426+0000 7fb7cc629700 1 Processor -- start 2023-09-28T00:15:40.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.427+0000 7fb7cc629700 1 -- start start 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.427+0000 7fb7cc629700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7c4159500 0x7fb7c41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.427+0000 7fb7cc629700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c40b3fd0 0x7fb7c415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.427+0000 7fb7cc629700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c415dd20 con 0x7fb7c415d8e0 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7cc629700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c40b1110 con 0x7fb7c4159500 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7cc629700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c40b13b0 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7ca3c5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7c4159500 0x7fb7c41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7ca3c5700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7c4159500 0x7fb7c41598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46850/0 (socket says 172.21.15.26:46850) 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7ca3c5700 1 -- 172.21.15.26:0/2878595762 learned_addr learned my addr 172.21.15.26:0/2878595762 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7c9bc4700 1 --2- 172.21.15.26:0/2878595762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c40b3fd0 0x7fb7c415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.430 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7ca3c5700 1 -- 172.21.15.26:0/2878595762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c40b3fd0 msgr2=0x7fb7c415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7ca3c5700 1 --2- 172.21.15.26:0/2878595762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c40b3fd0 0x7fb7c415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7ca3c5700 1 -- 172.21.15.26:0/2878595762 >> v1:172.21.15.190:6789/0 conn(0x7fb7c415d8e0 legacy=0x7fb7c40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7ca3c5700 1 -- 172.21.15.26:0/2878595762 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40b1690 con 0x7fb7c4159500 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7ca3c5700 1 --2- 172.21.15.26:0/2878595762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c4159500 0x7fb7c41598d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0099b0 tx=0x7fb7bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb54ef107d1892f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7c93c3700 1 -- 172.21.15.26:0/2878595762 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc00b860 con 0x7fb7c4159500 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7c93c3700 1 -- 172.21.15.26:0/2878595762 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc00b9c0 con 0x7fb7c4159500 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.428+0000 7fb7c93c3700 1 -- 172.21.15.26:0/2878595762 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc00bd60 con 0x7fb7c4159500 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.429+0000 7fb7cc629700 1 -- 172.21.15.26:0/2878595762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c4159500 msgr2=0x7fb7c41598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.429+0000 7fb7cc629700 1 --2- 172.21.15.26:0/2878595762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c4159500 0x7fb7c41598d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc0099b0 tx=0x7fb7bc009250 comp rx=0 tx=0).stop 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.429+0000 7fb7cc629700 1 -- 172.21.15.26:0/2878595762 shutdown_connections 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.429+0000 7fb7cc629700 1 --2- 172.21.15.26:0/2878595762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c4159500 0x7fb7c41598d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.429+0000 7fb7cc629700 1 --2- 172.21.15.26:0/2878595762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c40b3fd0 0x7fb7c415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.429+0000 7fb7cc629700 1 -- 172.21.15.26:0/2878595762 >> 172.21.15.26:0/2878595762 conn(0x7fb7c4067630 msgr2=0x7fb7c4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:40.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.429+0000 7fb7cc629700 1 -- 172.21.15.26:0/2878595762 shutdown_connections 2023-09-28T00:15:40.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.429+0000 7fb7cc629700 1 -- 172.21.15.26:0/2878595762 wait complete. 2023-09-28T00:15:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.430+0000 7fb7cc629700 1 Processor -- start 2023-09-28T00:15:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.430+0000 7fb7cc629700 1 -- start start 2023-09-28T00:15:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7cc629700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c40b3fd0 0x7fb7c41547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7cc629700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c4159500 0x7fb7c415c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7cc629700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7c415d8e0 0x7fb7c414d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7cc629700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c41598d0 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7cc629700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c415cf30 con 0x7fb7c415d8e0 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7cc629700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c414d740 con 0x7fb7c4159500 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7ca3c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c40b3fd0 0x7fb7c41547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7ca3c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c40b3fd0 0x7fb7c41547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46862/0 (socket says 172.21.15.26:46862) 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7ca3c5700 1 -- 172.21.15.26:0/1940484787 learned_addr learned my addr 172.21.15.26:0/1940484787 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7c9bc4700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c4159500 0x7fb7c415c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7cabc6700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7c415d8e0 0x7fb7c414d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7ca3c5700 1 -- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c4159500 msgr2=0x7fb7c415c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7ca3c5700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c4159500 0x7fb7c415c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7ca3c5700 1 -- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7c415d8e0 msgr2=0x7fb7c414d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7ca3c5700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7c415d8e0 0x7fb7c414d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7ca3c5700 1 -- 172.21.15.26:0/1940484787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0094f0 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7c9bc4700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c4159500 0x7fb7c415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7cabc6700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7c415d8e0 0x7fb7c414d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.431+0000 7fb7ca3c5700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c40b3fd0 0x7fb7c41547f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb7c415deb0 tx=0x7fb7bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.432+0000 7fb7c27fc700 1 -- 172.21.15.26:0/1940484787 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc024440 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.432+0000 7fb7c27fc700 1 -- 172.21.15.26:0/1940484787 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc0245c0 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.432+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c4154e80 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.432+0000 7fb7c27fc700 1 -- 172.21.15.26:0/1940484787 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc024980 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.432+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c4159e00 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.433+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c4064050 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.433+0000 7fb7c27fc700 1 -- 172.21.15.26:0/1940484787 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb7bc01a420 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.433+0000 7fb7c27fc700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb7b0067330 0x7fb7b00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.434+0000 7fb7c27fc700 1 -- 172.21.15.26:0/1940484787 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb7bc086960 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.434+0000 7fb7c9bc4700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb7b0067330 0x7fb7b00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.434+0000 7fb7c9bc4700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb7b0067330 0x7fb7b00697e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4158880 tx=0x7fb7b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:40.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.438+0000 7fb7c27fc700 1 -- 172.21.15.26:0/1940484787 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb7bc053860 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.629+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7c40b1970 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.629+0000 7fb7c27fc700 1 -- 172.21.15.26:0/1940484787 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb7bc056e80 con 0x7fb7c40b3fd0 2023-09-28T00:15:40.630 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-09-28T00:15:40.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb7b0067330 msgr2=0x7fb7b00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb7b0067330 0x7fb7b00697e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4158880 tx=0x7fb7b8008040 comp rx=0 tx=0).stop 2023-09-28T00:15:40.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c40b3fd0 msgr2=0x7fb7c41547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c40b3fd0 0x7fb7c41547f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb7c415deb0 tx=0x7fb7bc017000 comp rx=0 tx=0).stop 2023-09-28T00:15:40.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 shutdown_connections 2023-09-28T00:15:40.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb7b0067330 0x7fb7b00697e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7c415d8e0 0x7fb7c414d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7c40b3fd0 0x7fb7c41547f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 --2- 172.21.15.26:0/1940484787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7c4159500 0x7fb7c415c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 >> 172.21.15.26:0/1940484787 conn(0x7fb7c4067630 msgr2=0x7fb7c40b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:40.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 shutdown_connections 2023-09-28T00:15:40.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.631+0000 7fb7cc629700 1 -- 172.21.15.26:0/1940484787 wait complete. 2023-09-28T00:15:40.644 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-28T00:15:40.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.764+0000 7f91a5b4b700 1 Processor -- start 2023-09-28T00:15:40.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.764+0000 7f91a5b4b700 1 -- start start 2023-09-28T00:15:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.764+0000 7f91a5b4b700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f91a0159500 0x7f91a00cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.764+0000 7f91a5b4b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a01598d0 0x7f91a00cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.764+0000 7f91a5b4b700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91a00cad40 0x7f91a00cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.764+0000 7f91a5b4b700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00cba90 con 0x7f91a00cad40 2023-09-28T00:15:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.764+0000 7f91a5b4b700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00cbd70 con 0x7f91a0159500 2023-09-28T00:15:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.764+0000 7f91a5b4b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00cc050 con 0x7f91a01598d0 2023-09-28T00:15:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91a00cad40 0x7f91a00cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919ffff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f91a00cad40 0x7f91a00cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46870/0 (socket says 172.21.15.26:46870) 2023-09-28T00:15:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919ffff700 1 -- 172.21.15.26:0/1787513360 learned_addr learned my addr 172.21.15.26:0/1787513360 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919effd700 1 --2- 172.21.15.26:0/1787513360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a01598d0 0x7f91a00cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919f7fe700 1 --2- 172.21.15.26:0/1787513360 >> v2:172.21.15.190:3300/0 conn(0x7f91a0159500 0x7f91a00cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919ffff700 1 -- 172.21.15.26:0/1787513360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a01598d0 msgr2=0x7f91a00cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919ffff700 1 --2- 172.21.15.26:0/1787513360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a01598d0 0x7f91a00cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919ffff700 1 -- 172.21.15.26:0/1787513360 >> v2:172.21.15.190:3300/0 conn(0x7f91a0159500 msgr2=0x7f91a00cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919ffff700 1 --2- 172.21.15.26:0/1787513360 >> v2:172.21.15.190:3300/0 conn(0x7f91a0159500 0x7f91a00cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919ffff700 1 -- 172.21.15.26:0/1787513360 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00cc330 con 0x7f91a00cad40 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919effd700 1 --2- 172.21.15.26:0/1787513360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a01598d0 0x7f91a00cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919f7fe700 1 --2- 172.21.15.26:0/1787513360 >> v2:172.21.15.190:3300/0 conn(0x7f91a0159500 0x7f91a00cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:40.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919ffff700 1 --2- 172.21.15.26:0/1787513360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a00cad40 0x7f91a00cb1e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91a00896d0 tx=0x7f9198009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276ef842af1e7678 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919e7fc700 1 -- 172.21.15.26:0/1787513360 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919800e070 con 0x7f91a00cad40 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919e7fc700 1 -- 172.21.15.26:0/1787513360 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919800ba50 con 0x7f91a00cad40 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.765+0000 7f919e7fc700 1 -- 172.21.15.26:0/1787513360 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980092e0 con 0x7f91a00cad40 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.766+0000 7f91a5b4b700 1 -- 172.21.15.26:0/1787513360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a00cad40 msgr2=0x7f91a00cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.766+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/1787513360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a00cad40 0x7f91a00cb1e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f91a00896d0 tx=0x7f9198009840 comp rx=0 tx=0).stop 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.766+0000 7f91a5b4b700 1 -- 172.21.15.26:0/1787513360 shutdown_connections 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.766+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/1787513360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a00cad40 0x7f91a00cb1e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.766+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/1787513360 >> v2:172.21.15.190:3300/0 conn(0x7f91a0159500 0x7f91a00cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.766+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/1787513360 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a01598d0 0x7f91a00cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.770 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.766+0000 7f91a5b4b700 1 -- 172.21.15.26:0/1787513360 >> 172.21.15.26:0/1787513360 conn(0x7f91a00cd090 msgr2=0x7f91a00cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:40.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.766+0000 7f91a5b4b700 1 -- 172.21.15.26:0/1787513360 shutdown_connections 2023-09-28T00:15:40.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.766+0000 7f91a5b4b700 1 -- 172.21.15.26:0/1787513360 wait complete. 2023-09-28T00:15:40.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.767+0000 7f91a5b4b700 1 Processor -- start 2023-09-28T00:15:40.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.767+0000 7f91a5b4b700 1 -- start start 2023-09-28T00:15:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91a5b4b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a00cad40 0x7f91a00b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91a5b4b700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a0159500 0x7f91a00b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91a5b4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a01598d0 0x7f91a00b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91a5b4b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a0159f60 con 0x7f91a01598d0 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91a5b4b700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a0140fe0 con 0x7f91a00cad40 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91a5b4b700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a015a4e0 con 0x7f91a0159500 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a01598d0 0x7f91a00b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a01598d0 0x7f91a00b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46880/0 (socket says 172.21.15.26:46880) 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919ffff700 1 -- 172.21.15.26:0/4244816224 learned_addr learned my addr 172.21.15.26:0/4244816224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919effd700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a0159500 0x7f91a00b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919f7fe700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a00cad40 0x7f91a00b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919ffff700 1 -- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a0159500 msgr2=0x7f91a00b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919ffff700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a0159500 0x7f91a00b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919ffff700 1 -- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a00cad40 msgr2=0x7f91a00b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919ffff700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a00cad40 0x7f91a00b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919ffff700 1 -- 172.21.15.26:0/4244816224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9198009ae0 con 0x7f91a01598d0 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f919ffff700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a01598d0 0x7f91a00b4fc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9198009fd0 tx=0x7f9198018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91877fe700 1 -- 172.21.15.26:0/4244816224 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980094e0 con 0x7f91a01598d0 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91877fe700 1 -- 172.21.15.26:0/4244816224 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91980032f0 con 0x7f91a01598d0 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a00b1c00 con 0x7f91a01598d0 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91877fe700 1 -- 172.21.15.26:0/4244816224 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980266b0 con 0x7f91a01598d0 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.768+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a015a170 con 0x7f91a01598d0 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.769+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a015a690 con 0x7f91a01598d0 2023-09-28T00:15:40.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.770+0000 7f91877fe700 1 -- 172.21.15.26:0/4244816224 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f9198003040 con 0x7f91a01598d0 2023-09-28T00:15:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.770+0000 7f91877fe700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f918c067330 0x7f918c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.770+0000 7f91877fe700 1 -- 172.21.15.26:0/4244816224 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9198086c00 con 0x7f91a01598d0 2023-09-28T00:15:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.770+0000 7f919f7fe700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f918c067330 0x7f918c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.771+0000 7f919f7fe700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f918c067330 0x7f918c0697e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f919000ab30 tx=0x7f9190008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.774+0000 7f91877fe700 1 -- 172.21.15.26:0/4244816224 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f91a015a690 con 0x7f91a01598d0 2023-09-28T00:15:40.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.966+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91a015a650 con 0x7f91a01598d0 2023-09-28T00:15:40.967 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.966+0000 7f91877fe700 1 -- 172.21.15.26:0/4244816224 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f919802b0a0 con 0x7f91a01598d0 2023-09-28T00:15:40.967 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-09-28T00:15:40.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f918c067330 msgr2=0x7f918c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.969 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f918c067330 0x7f918c0697e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f919000ab30 tx=0x7f9190008040 comp rx=0 tx=0).stop 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a01598d0 msgr2=0x7f91a00b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a01598d0 0x7f91a00b4fc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9198009fd0 tx=0x7f9198018000 comp rx=0 tx=0).stop 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 shutdown_connections 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f918c067330 0x7f918c0697e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91a01598d0 0x7f91a00b4fc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f91a00cad40 0x7f91a00b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 --2- 172.21.15.26:0/4244816224 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f91a0159500 0x7f91a00b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 >> 172.21.15.26:0/4244816224 conn(0x7f91a00cd090 msgr2=0x7f91a0156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 shutdown_connections 2023-09-28T00:15:40.970 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:40.968+0000 7f91a5b4b700 1 -- 172.21.15.26:0/4244816224 wait complete. 2023-09-28T00:15:40.982 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:15:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.100+0000 7f1846228700 1 Processor -- start 2023-09-28T00:15:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.100+0000 7f1846228700 1 -- start start 2023-09-28T00:15:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.100+0000 7f1846228700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f184015d560 0x7f18400d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.100+0000 7f1846228700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18401591b0 0x7f1840159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.100+0000 7f1846228700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18400b2ad0 con 0x7f184015d930 2023-09-28T00:15:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.100+0000 7f1846228700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18400b4160 con 0x7f184015d560 2023-09-28T00:15:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.100+0000 7f1846228700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1840159b70 con 0x7f18401591b0 2023-09-28T00:15:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.100+0000 7f183f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f184015d560 0x7f18400d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.100+0000 7f183effd700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f184015d930 0x7f18400b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:44074/0 (socket says 172.21.15.26:44074) 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f184015d560 0x7f18400d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:46886/0 (socket says 172.21.15.26:46886) 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183effd700 1 -- 172.21.15.26:0/2433720717 learned_addr learned my addr 172.21.15.26:0/2433720717 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183f7fe700 1 -- 172.21.15.26:0/2433720717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18401591b0 msgr2=0x7f1840159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183ffff700 1 --2- 172.21.15.26:0/2433720717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18401591b0 0x7f1840159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183f7fe700 1 --2- 172.21.15.26:0/2433720717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18401591b0 0x7f1840159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183f7fe700 1 -- 172.21.15.26:0/2433720717 >> v1:172.21.15.26:6789/0 conn(0x7f184015d930 legacy=0x7f18400b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183e7fc700 1 -- 172.21.15.26:0/2433720717 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172350647 0 0) 0x7f18400b2ad0 con 0x7f184015d930 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183f7fe700 1 -- 172.21.15.26:0/2433720717 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18400b2230 con 0x7f184015d560 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183ffff700 1 --2- 172.21.15.26:0/2433720717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18401591b0 0x7f1840159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183f7fe700 1 --2- 172.21.15.26:0/2433720717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d560 0x7f18400d0030 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f18300098e0 tx=0x7f18300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c86460e54e0db0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183e7fc700 1 -- 172.21.15.26:0/2433720717 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830009e80 con 0x7f184015d560 2023-09-28T00:15:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183e7fc700 1 -- 172.21.15.26:0/2433720717 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183000b860 con 0x7f184015d560 2023-09-28T00:15:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.101+0000 7f183e7fc700 1 -- 172.21.15.26:0/2433720717 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183000bbe0 con 0x7f184015d560 2023-09-28T00:15:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.102+0000 7f1846228700 1 -- 172.21.15.26:0/2433720717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d560 msgr2=0x7f18400d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.102+0000 7f1846228700 1 --2- 172.21.15.26:0/2433720717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d560 0x7f18400d0030 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f18300098e0 tx=0x7f18300091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.102+0000 7f1846228700 1 -- 172.21.15.26:0/2433720717 shutdown_connections 2023-09-28T00:15:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.102+0000 7f1846228700 1 --2- 172.21.15.26:0/2433720717 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f18401591b0 0x7f1840159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.102+0000 7f1846228700 1 --2- 172.21.15.26:0/2433720717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d560 0x7f18400d0030 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.102+0000 7f1846228700 1 -- 172.21.15.26:0/2433720717 >> 172.21.15.26:0/2433720717 conn(0x7f18400d1180 msgr2=0x7f1840069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.102+0000 7f1846228700 1 -- 172.21.15.26:0/2433720717 shutdown_connections 2023-09-28T00:15:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.102+0000 7f1846228700 1 -- 172.21.15.26:0/2433720717 wait complete. 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.103+0000 7f1846228700 1 Processor -- start 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.103+0000 7f1846228700 1 -- start start 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f1846228700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18401591b0 0x7f18400b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f1846228700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184015d560 0x7f18401549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f1846228700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d930 0x7f1840154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f1846228700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1840169fa0 con 0x7f184015d930 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f1846228700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184015ce50 con 0x7f18401591b0 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f1846228700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1840169690 con 0x7f184015d560 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183effd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184015d560 0x7f18401549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183f7fe700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18401591b0 0x7f18400b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183effd700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184015d560 0x7f18401549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:34982/0 (socket says 172.21.15.26:34982) 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183effd700 1 -- 172.21.15.26:0/2126656578 learned_addr learned my addr 172.21.15.26:0/2126656578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183ffff700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d930 0x7f1840154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183ffff700 1 -- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184015d560 msgr2=0x7f18401549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183ffff700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184015d560 0x7f18401549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183ffff700 1 -- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18401591b0 msgr2=0x7f18400b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183ffff700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18401591b0 0x7f18400b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183ffff700 1 -- 172.21.15.26:0/2126656578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830009420 con 0x7f184015d930 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f183ffff700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d930 0x7f1840154ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f183800cf30 tx=0x7f1838007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.104+0000 7f18277fe700 1 -- 172.21.15.26:0/2126656578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800ae40 con 0x7f184015d930 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.105+0000 7f18277fe700 1 -- 172.21.15.26:0/2126656578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1838015440 con 0x7f184015d930 2023-09-28T00:15:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.105+0000 7f18277fe700 1 -- 172.21.15.26:0/2126656578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838015800 con 0x7f184015d930 2023-09-28T00:15:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.105+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18400b1a00 con 0x7f184015d930 2023-09-28T00:15:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.105+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1840169c30 con 0x7f184015d930 2023-09-28T00:15:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.105+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1840064050 con 0x7f184015d930 2023-09-28T00:15:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.106+0000 7f18277fe700 1 -- 172.21.15.26:0/2126656578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f183800d440 con 0x7f184015d930 2023-09-28T00:15:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.106+0000 7f18277fe700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f182c067330 0x7f182c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.106+0000 7f18277fe700 1 -- 172.21.15.26:0/2126656578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1838085760 con 0x7f184015d930 2023-09-28T00:15:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.106+0000 7f183f7fe700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f182c067330 0x7f182c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.107+0000 7f183f7fe700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f182c067330 0x7f182c0697e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18300091e0 tx=0x7f1830017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:41.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.110+0000 7f18277fe700 1 -- 172.21.15.26:0/2126656578 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1838052660 con 0x7f184015d930 2023-09-28T00:15:41.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.348+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f184016a0e0 con 0x7f184015d930 2023-09-28T00:15:41.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.348+0000 7f18277fe700 1 -- 172.21.15.26:0/2126656578 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f1838055c80 con 0x7f184015d930 2023-09-28T00:15:41.350 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:41.350 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1101672577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1101672577},{"type":"v1","addr":"172.21.15.190:6836","nonce":1101672577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3243251915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3243251915},{"type":"v1","addr":"172.21.15.26:6834","nonce":3243251915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/501056069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":501056069},{"type":"v1","addr":"172.21.15.26:6835","nonce":501056069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:15:29.372185+0000","modified":"2023-09-28T00:15:32.384937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/3098279304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3098279304},{"type":"v1","addr":"172.21.15.190:6837","nonce":3098279304}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f182c067330 msgr2=0x7f182c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f182c067330 0x7f182c0697e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18300091e0 tx=0x7f1830017000 comp rx=0 tx=0).stop 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d930 msgr2=0x7f1840154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d930 0x7f1840154ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f183800cf30 tx=0x7f1838007840 comp rx=0 tx=0).stop 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 shutdown_connections 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f182c067330 0x7f182c0697e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f184015d930 0x7f1840154ee0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18401591b0 0x7f18400b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 --2- 172.21.15.26:0/2126656578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f184015d560 0x7f18401549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 >> 172.21.15.26:0/2126656578 conn(0x7f18400d1180 msgr2=0x7f1840067710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 shutdown_connections 2023-09-28T00:15:41.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.350+0000 7f1846228700 1 -- 172.21.15.26:0/2126656578 wait complete. 2023-09-28T00:15:41.353 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-09-28T00:15:41.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.482+0000 7fe35a468700 1 Processor -- start 2023-09-28T00:15:41.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.482+0000 7fe35a468700 1 -- start start 2023-09-28T00:15:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.482+0000 7fe35a468700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe35415d560 0x7fe3540d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.482+0000 7fe35a468700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe35415d930 0x7fe3540b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.482+0000 7fe35a468700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe354159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.482+0000 7fe35a468700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3540b2ad0 con 0x7fe35415d930 2023-09-28T00:15:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.482+0000 7fe35a468700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3540b4160 con 0x7fe35415d560 2023-09-28T00:15:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.482+0000 7fe35a468700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3540b1f80 con 0x7fe3541591b0 2023-09-28T00:15:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe3537fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe35415d930 0x7fe3540b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe3537fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe35415d930 0x7fe3540b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39956/0 (socket says 172.21.15.26:39956) 2023-09-28T00:15:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe3537fe700 1 -- 172.21.15.26:0/2685806327 learned_addr learned my addr 172.21.15.26:0/2685806327 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe358a05700 1 --2- 172.21.15.26:0/2685806327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe354159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe353fff700 1 --2- 172.21.15.26:0/2685806327 >> v2:172.21.15.190:3300/0 conn(0x7fe35415d560 0x7fe3540d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe3537fe700 1 -- 172.21.15.26:0/2685806327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 msgr2=0x7fe354159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe3537fe700 1 --2- 172.21.15.26:0/2685806327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe354159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe3537fe700 1 -- 172.21.15.26:0/2685806327 >> v2:172.21.15.190:3300/0 conn(0x7fe35415d560 msgr2=0x7fe3540d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe3537fe700 1 --2- 172.21.15.26:0/2685806327 >> v2:172.21.15.190:3300/0 conn(0x7fe35415d560 0x7fe3540d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe3537fe700 1 -- 172.21.15.26:0/2685806327 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe354159b70 con 0x7fe35415d930 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe358a05700 1 --2- 172.21.15.26:0/2685806327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe354159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe353fff700 1 --2- 172.21.15.26:0/2685806327 >> v2:172.21.15.190:3300/0 conn(0x7fe35415d560 0x7fe3540d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe3537fe700 1 --2- 172.21.15.26:0/2685806327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d930 0x7fe3540b1a40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe354071410 tx=0x7fe348009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb89cf27dadabad5 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe352ffd700 1 -- 172.21.15.26:0/2685806327 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800b860 con 0x7fe35415d930 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe352ffd700 1 -- 172.21.15.26:0/2685806327 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800b9c0 con 0x7fe35415d930 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.483+0000 7fe352ffd700 1 -- 172.21.15.26:0/2685806327 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800bd60 con 0x7fe35415d930 2023-09-28T00:15:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.484+0000 7fe35a468700 1 -- 172.21.15.26:0/2685806327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d930 msgr2=0x7fe3540b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.484+0000 7fe35a468700 1 --2- 172.21.15.26:0/2685806327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d930 0x7fe3540b1a40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe354071410 tx=0x7fe348009250 comp rx=0 tx=0).stop 2023-09-28T00:15:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.484+0000 7fe35a468700 1 -- 172.21.15.26:0/2685806327 shutdown_connections 2023-09-28T00:15:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.484+0000 7fe35a468700 1 --2- 172.21.15.26:0/2685806327 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe354159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.484+0000 7fe35a468700 1 --2- 172.21.15.26:0/2685806327 >> v2:172.21.15.190:3300/0 conn(0x7fe35415d560 0x7fe3540d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.484+0000 7fe35a468700 1 --2- 172.21.15.26:0/2685806327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d930 0x7fe3540b1a40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.484+0000 7fe35a468700 1 -- 172.21.15.26:0/2685806327 >> 172.21.15.26:0/2685806327 conn(0x7fe3540d1180 msgr2=0x7fe354069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.484+0000 7fe35a468700 1 -- 172.21.15.26:0/2685806327 shutdown_connections 2023-09-28T00:15:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.484+0000 7fe35a468700 1 -- 172.21.15.26:0/2685806327 wait complete. 2023-09-28T00:15:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.485+0000 7fe35a468700 1 Processor -- start 2023-09-28T00:15:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.485+0000 7fe35a468700 1 -- start start 2023-09-28T00:15:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe35a468700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe35414e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe35a468700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d560 0x7fe35414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe35a468700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe35415d930 0x7fe3540b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe35a468700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35415ad30 con 0x7fe35415d560 2023-09-28T00:15:41.491 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe35a468700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35415b5d0 con 0x7fe35415d930 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe35a468700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35414f5c0 con 0x7fe3541591b0 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe3537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d560 0x7fe35414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe3537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d560 0x7fe35414ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39960/0 (socket says 172.21.15.26:39960) 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe3537fe700 1 -- 172.21.15.26:0/1192031936 learned_addr learned my addr 172.21.15.26:0/1192031936 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe358a05700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe35415d930 0x7fe3540b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe353fff700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe35414e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe3537fe700 1 -- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 msgr2=0x7fe35414e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe3537fe700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe35414e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe3537fe700 1 -- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe35415d930 msgr2=0x7fe3540b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe3537fe700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe35415d930 0x7fe3540b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe3537fe700 1 -- 172.21.15.26:0/1192031936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3480094f0 con 0x7fe35415d560 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe353fff700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe35414e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.486+0000 7fe3537fe700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d560 0x7fe35414ec50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe354064a20 tx=0x7fe348017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.487+0000 7fe33bfff700 1 -- 172.21.15.26:0/1192031936 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34801a450 con 0x7fe35415d560 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.487+0000 7fe33bfff700 1 -- 172.21.15.26:0/1192031936 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34801a5b0 con 0x7fe35415d560 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.487+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35415af80 con 0x7fe35415d560 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.487+0000 7fe33bfff700 1 -- 172.21.15.26:0/1192031936 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34801a970 con 0x7fe35415d560 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.487+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35414e720 con 0x7fe35415d560 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.487+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35415b780 con 0x7fe35415d560 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.488+0000 7fe33bfff700 1 -- 172.21.15.26:0/1192031936 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe34801ace0 con 0x7fe35415d560 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.488+0000 7fe33bfff700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe340067330 0x7fe3400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.488+0000 7fe33bfff700 1 -- 172.21.15.26:0/1192031936 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3480867d0 con 0x7fe35415d560 2023-09-28T00:15:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.488+0000 7fe353fff700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe340067330 0x7fe3400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.489+0000 7fe353fff700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe340067330 0x7fe3400697e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe344008b20 tx=0x7fe344008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.493+0000 7fe33bfff700 1 -- 172.21.15.26:0/1192031936 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe35415b780 con 0x7fe35415d560 2023-09-28T00:15:41.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.691+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe35415b740 con 0x7fe35415d560 2023-09-28T00:15:41.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.692+0000 7fe33bfff700 1 -- 172.21.15.26:0/1192031936 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7fe3480536b0 con 0x7fe35415d560 2023-09-28T00:15:41.693 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:41.693 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:30.373905+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:41.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe340067330 msgr2=0x7fe3400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe340067330 0x7fe3400697e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe344008b20 tx=0x7fe344008040 comp rx=0 tx=0).stop 2023-09-28T00:15:41.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d560 msgr2=0x7fe35414ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d560 0x7fe35414ec50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe354064a20 tx=0x7fe348017000 comp rx=0 tx=0).stop 2023-09-28T00:15:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 shutdown_connections 2023-09-28T00:15:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe340067330 0x7fe3400697e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3541591b0 0x7fe35414e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe35415d930 0x7fe3540b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 --2- 172.21.15.26:0/1192031936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe35415d560 0x7fe35414ec50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 >> 172.21.15.26:0/1192031936 conn(0x7fe3540d1180 msgr2=0x7fe354067cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 shutdown_connections 2023-09-28T00:15:41.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.694+0000 7fe35a468700 1 -- 172.21.15.26:0/1192031936 wait complete. 2023-09-28T00:15:41.707 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:15:41.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.825+0000 7fc818391700 1 Processor -- start 2023-09-28T00:15:41.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.825+0000 7fc818391700 1 -- start start 2023-09-28T00:15:41.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.826+0000 7fc818391700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc81015d560 0x7fc8100d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.826+0000 7fc818391700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc81015d930 0x7fc8100b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.826+0000 7fc818391700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8100b2ad0 con 0x7fc8101591b0 2023-09-28T00:15:41.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.826+0000 7fc818391700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8100b4160 con 0x7fc81015d560 2023-09-28T00:15:41.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.826+0000 7fc818391700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8100b1f80 con 0x7fc81015d930 2023-09-28T00:15:41.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.826+0000 7fc81612d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc81015d560 0x7fc8100d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.826+0000 7fc81692e700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc8101591b0 0x7fc810159630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49214/0 (socket says 172.21.15.26:49214) 2023-09-28T00:15:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.826+0000 7fc81692e700 1 -- 172.21.15.26:0/4033349406 learned_addr learned my addr 172.21.15.26:0/4033349406 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.826+0000 7fc81592c700 1 --2- 172.21.15.26:0/4033349406 >> v2:172.21.15.190:3300/0 conn(0x7fc81015d930 0x7fc8100b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81512b700 1 -- 172.21.15.26:0/4033349406 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037973982 0 0) 0x7fc8100b2ad0 con 0x7fc8101591b0 2023-09-28T00:15:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81512b700 1 -- 172.21.15.26:0/4033349406 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f8003570 con 0x7fc8101591b0 2023-09-28T00:15:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81612d700 1 -- 172.21.15.26:0/4033349406 >> v2:172.21.15.190:3300/0 conn(0x7fc81015d930 msgr2=0x7fc8100b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81612d700 1 --2- 172.21.15.26:0/4033349406 >> v2:172.21.15.190:3300/0 conn(0x7fc81015d930 0x7fc8100b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81612d700 1 -- 172.21.15.26:0/4033349406 >> v1:172.21.15.26:6789/0 conn(0x7fc8101591b0 legacy=0x7fc810159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81612d700 1 -- 172.21.15.26:0/4033349406 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8100b2230 con 0x7fc81015d560 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81612d700 1 --2- 172.21.15.26:0/4033349406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d560 0x7fc8100d0030 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc81015e440 tx=0x7fc8080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0b100c6e6b6555 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81512b700 1 -- 172.21.15.26:0/4033349406 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808011630 con 0x7fc81015d560 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81512b700 1 -- 172.21.15.26:0/4033349406 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8080117b0 con 0x7fc81015d560 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc81512b700 1 -- 172.21.15.26:0/4033349406 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808011b70 con 0x7fc81015d560 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc818391700 1 -- 172.21.15.26:0/4033349406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d560 msgr2=0x7fc8100d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc818391700 1 --2- 172.21.15.26:0/4033349406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d560 0x7fc8100d0030 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc81015e440 tx=0x7fc8080091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc818391700 1 -- 172.21.15.26:0/4033349406 shutdown_connections 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc818391700 1 --2- 172.21.15.26:0/4033349406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d560 0x7fc8100d0030 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.827+0000 7fc818391700 1 --2- 172.21.15.26:0/4033349406 >> v2:172.21.15.190:3300/0 conn(0x7fc81015d930 0x7fc8100b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.828+0000 7fc818391700 1 -- 172.21.15.26:0/4033349406 >> 172.21.15.26:0/4033349406 conn(0x7fc8100d1180 msgr2=0x7fc810069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.828+0000 7fc818391700 1 -- 172.21.15.26:0/4033349406 shutdown_connections 2023-09-28T00:15:41.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.828+0000 7fc818391700 1 -- 172.21.15.26:0/4033349406 wait complete. 2023-09-28T00:15:41.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc818391700 1 Processor -- start 2023-09-28T00:15:41.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc818391700 1 -- start start 2023-09-28T00:15:41.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc818391700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8101591b0 0x7fc810154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc818391700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc81015d560 0x7fc81014fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc818391700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d930 0x7fc810159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc818391700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8101558b0 con 0x7fc81015d930 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc818391700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc810155b90 con 0x7fc81015d560 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc818391700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc810155e70 con 0x7fc8101591b0 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc81692e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d930 0x7fc810159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc81692e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d930 0x7fc810159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39974/0 (socket says 172.21.15.26:39974) 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc81692e700 1 -- 172.21.15.26:0/2435498442 learned_addr learned my addr 172.21.15.26:0/2435498442 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.829+0000 7fc81612d700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8101591b0 0x7fc810154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc81592c700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc81015d560 0x7fc81014fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc81692e700 1 -- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8101591b0 msgr2=0x7fc810154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc81692e700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8101591b0 0x7fc810154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc81692e700 1 -- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc81015d560 msgr2=0x7fc81014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:41.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc81692e700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc81015d560 0x7fc81014fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc81692e700 1 -- 172.21.15.26:0/2435498442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc808009420 con 0x7fc81015d930 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc81692e700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d930 0x7fc810159630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc800001460 tx=0x7fc800001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc80e7fc700 1 -- 172.21.15.26:0/2435498442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80000a870 con 0x7fc81015d930 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc80e7fc700 1 -- 172.21.15.26:0/2435498442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80000a9d0 con 0x7fc81015d930 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc810151960 con 0x7fc81015d930 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc80e7fc700 1 -- 172.21.15.26:0/2435498442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80000ad50 con 0x7fc81015d930 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.830+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc810150740 con 0x7fc81015d930 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.831+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc810064050 con 0x7fc81015d930 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.831+0000 7fc80e7fc700 1 -- 172.21.15.26:0/2435498442 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc800007300 con 0x7fc81015d930 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.832+0000 7fc80e7fc700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc7fc067330 0x7fc7fc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.832+0000 7fc80e7fc700 1 -- 172.21.15.26:0/2435498442 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc800084e60 con 0x7fc81015d930 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.832+0000 7fc81612d700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc7fc067330 0x7fc7fc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:41.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.832+0000 7fc81612d700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc7fc067330 0x7fc7fc0697e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc81015e440 tx=0x7fc808017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:41.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:41.836+0000 7fc80e7fc700 1 -- 172.21.15.26:0/2435498442 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc800051de0 con 0x7fc81015d930 2023-09-28T00:15:42.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.075+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8100b2510 con 0x7fc81015d930 2023-09-28T00:15:42.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.075+0000 7fc80e7fc700 1 -- 172.21.15.26:0/2435498442 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fc800055400 con 0x7fc81015d930 2023-09-28T00:15:42.077 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:42.078 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1101672577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1101672577},{"type":"v1","addr":"172.21.15.190:6836","nonce":1101672577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3243251915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3243251915},{"type":"v1","addr":"172.21.15.26:6834","nonce":3243251915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/501056069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":501056069},{"type":"v1","addr":"172.21.15.26:6835","nonce":501056069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:15:29.372185+0000","modified":"2023-09-28T00:15:32.384937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/3098279304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3098279304},{"type":"v1","addr":"172.21.15.190:6837","nonce":3098279304}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc7fc067330 msgr2=0x7fc7fc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc7fc067330 0x7fc7fc0697e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc81015e440 tx=0x7fc808017000 comp rx=0 tx=0).stop 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d930 msgr2=0x7fc810159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d930 0x7fc810159630 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc800001460 tx=0x7fc800001a40 comp rx=0 tx=0).stop 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 shutdown_connections 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc7fc067330 0x7fc7fc0697e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc8101591b0 0x7fc810154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc81015d930 0x7fc810159630 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 --2- 172.21.15.26:0/2435498442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc81015d560 0x7fc81014fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 >> 172.21.15.26:0/2435498442 conn(0x7fc8100d1180 msgr2=0x7fc810158380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:42.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 shutdown_connections 2023-09-28T00:15:42.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.077+0000 7fc818391700 1 -- 172.21.15.26:0/2435498442 wait complete. 2023-09-28T00:15:42.080 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-09-28T00:15:42.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-28T00:15:29.372185+0000', 'modified': '2023-09-28T00:15:32.384937+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.190:6837/3098279304', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6835', 'nonce': 3098279304}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 3098279304}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-09-28T00:15:42.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-28T00:15:42.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-09-28T00:15:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.615+0000 7ffad6988700 1 Processor -- start 2023-09-28T00:15:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.615+0000 7ffad6988700 1 -- start start 2023-09-28T00:15:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.615+0000 7ffad6988700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad00af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.615+0000 7ffad6988700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffad00b4000 0x7ffad0159b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.615+0000 7ffad6988700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad00698e0 con 0x7ffad00b1690 2023-09-28T00:15:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.615+0000 7ffad6988700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad0068fd0 con 0x7ffad00b4000 2023-09-28T00:15:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.615+0000 7ffad6988700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00b0020 con 0x7ffad015cb10 2023-09-28T00:15:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffacf7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffad00b4000 0x7ffad0159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffad4f25700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffad00b1690 0x7ffad0069d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49224/0 (socket says 172.21.15.26:49224) 2023-09-28T00:15:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffad4f25700 1 -- 172.21.15.26:0/1361670271 learned_addr learned my addr 172.21.15.26:0/1361670271 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffacf7fe700 1 -- 172.21.15.26:0/1361670271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 msgr2=0x7ffad00af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffacffff700 1 --2- 172.21.15.26:0/1361670271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad00af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/1361670271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad00af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffacf7fe700 1 -- 172.21.15.26:0/1361670271 >> v1:172.21.15.26:6789/0 conn(0x7ffad00b1690 legacy=0x7ffad0069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffacf7fe700 1 -- 172.21.15.26:0/1361670271 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad0069290 con 0x7ffad00b4000 2023-09-28T00:15:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffaceffd700 1 -- 172.21.15.26:0/1361670271 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82333955 0 0) 0x7ffad00698e0 con 0x7ffad00b1690 2023-09-28T00:15:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffacffff700 1 --2- 172.21.15.26:0/1361670271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad00af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/1361670271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b4000 0x7ffad0159b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffac40098e0 tx=0x7ffac40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b6cecca2aa86fd2 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffaceffd700 1 -- 172.21.15.26:0/1361670271 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4009e80 con 0x7ffad00b4000 2023-09-28T00:15:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffaceffd700 1 -- 172.21.15.26:0/1361670271 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac400b860 con 0x7ffad00b4000 2023-09-28T00:15:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.616+0000 7ffaceffd700 1 -- 172.21.15.26:0/1361670271 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400bbe0 con 0x7ffad00b4000 2023-09-28T00:15:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.617+0000 7ffad6988700 1 -- 172.21.15.26:0/1361670271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b4000 msgr2=0x7ffad0159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.617+0000 7ffad6988700 1 --2- 172.21.15.26:0/1361670271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b4000 0x7ffad0159b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffac40098e0 tx=0x7ffac40091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.617+0000 7ffad6988700 1 -- 172.21.15.26:0/1361670271 shutdown_connections 2023-09-28T00:15:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.617+0000 7ffad6988700 1 --2- 172.21.15.26:0/1361670271 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad00af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.617+0000 7ffad6988700 1 --2- 172.21.15.26:0/1361670271 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b4000 0x7ffad0159b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.617+0000 7ffad6988700 1 -- 172.21.15.26:0/1361670271 >> 172.21.15.26:0/1361670271 conn(0x7ffad006d890 msgr2=0x7ffad006dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:42.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.617+0000 7ffad6988700 1 -- 172.21.15.26:0/1361670271 shutdown_connections 2023-09-28T00:15:42.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.617+0000 7ffad6988700 1 -- 172.21.15.26:0/1361670271 wait complete. 2023-09-28T00:15:42.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.618+0000 7ffad6988700 1 Processor -- start 2023-09-28T00:15:42.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.618+0000 7ffad6988700 1 -- start start 2023-09-28T00:15:42.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad6988700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b1690 0x7ffad0144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad6988700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad00b4000 0x7ffad0159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad6988700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad6988700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c90c0 con 0x7ffad00b1690 2023-09-28T00:15:42.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad6988700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00c87b0 con 0x7ffad00b4000 2023-09-28T00:15:42.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad6988700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0145120 con 0x7ffad015cb10 2023-09-28T00:15:42.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b1690 0x7ffad0144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b1690 0x7ffad0144be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39994/0 (socket says 172.21.15.26:39994) 2023-09-28T00:15:42.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacffff700 1 -- 172.21.15.26:0/189426274 learned_addr learned my addr 172.21.15.26:0/189426274 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:42.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad00b4000 0x7ffad0159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad4f25700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacffff700 1 -- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 msgr2=0x7ffad015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacffff700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacffff700 1 -- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad00b4000 msgr2=0x7ffad0159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacffff700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad00b4000 0x7ffad0159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacffff700 1 -- 172.21.15.26:0/189426274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4009420 con 0x7ffad00b1690 2023-09-28T00:15:42.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad00b4000 0x7ffad0159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:42.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad4f25700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:42.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffacffff700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b1690 0x7ffad0144be0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffac000c850 tx=0x7ffac0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:42.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffab7fff700 1 -- 172.21.15.26:0/189426274 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011600 con 0x7ffad00b1690 2023-09-28T00:15:42.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffab7fff700 1 -- 172.21.15.26:0/189426274 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0011760 con 0x7ffad00b1690 2023-09-28T00:15:42.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad6988700 1 -- 172.21.15.26:0/189426274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad016ac80 con 0x7ffad00b1690 2023-09-28T00:15:42.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffab7fff700 1 -- 172.21.15.26:0/189426274 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011b00 con 0x7ffad00b1690 2023-09-28T00:15:42.636 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.619+0000 7ffad6988700 1 -- 172.21.15.26:0/189426274 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad00c8ce0 con 0x7ffad00b1690 2023-09-28T00:15:42.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.621+0000 7ffab7fff700 1 -- 172.21.15.26:0/189426274 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ffac00073b0 con 0x7ffad00b1690 2023-09-28T00:15:42.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.621+0000 7ffab7fff700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffabc067330 0x7ffabc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.621+0000 7ffab7fff700 1 -- 172.21.15.26:0/189426274 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffac0084b60 con 0x7ffad00b1690 2023-09-28T00:15:42.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.621+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffabc067330 0x7ffabc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.622+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffabc067330 0x7ffabc0697e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffad00ad680 tx=0x7ffac4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:42.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.623+0000 7ffadfc7eb80 1 Processor -- start 2023-09-28T00:15:42.637 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.623+0000 7ffadfc7eb80 1 -- start start 2023-09-28T00:15:42.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b06d0cc0 0x55c3b071f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b071fc00 0x55c3b0720050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3b0626a70 con 0x55c3b06cf840 2023-09-28T00:15:42.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3b0624270 con 0x55c3b071fc00 2023-09-28T00:15:42.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3b0620060 con 0x55c3b06d0cc0 2023-09-28T00:15:42.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39998/0 (socket says 172.21.15.26:39998) 2023-09-28T00:15:42.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacffff700 1 -- 172.21.15.26:0/2927364068 learned_addr learned my addr 172.21.15.26:0/2927364068 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:42.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b06d0cc0 0x55c3b071f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffad4f25700 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b071fc00 0x55c3b0720050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacffff700 1 -- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b06d0cc0 msgr2=0x55c3b071f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:42.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacffff700 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b06d0cc0 0x55c3b071f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacffff700 1 -- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b071fc00 msgr2=0x55c3b0720050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:42.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacffff700 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b071fc00 0x55c3b0720050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacffff700 1 -- 172.21.15.26:0/2927364068 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3b04ba270 con 0x55c3b06cf840 2023-09-28T00:15:42.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffad4f25700 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b071fc00 0x55c3b0720050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:42.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.624+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b06d0cc0 0x55c3b071f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:42.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.625+0000 7ffacffff700 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06cfc10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffac0082ef0 tx=0x7ffac0082e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25da9295ca69b2e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:42.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.625+0000 7ffab57fa700 1 -- 172.21.15.26:0/2927364068 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0055720 con 0x55c3b06cf840 2023-09-28T00:15:42.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.625+0000 7ffab57fa700 1 -- 172.21.15.26:0/2927364068 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0058970 con 0x55c3b06cf840 2023-09-28T00:15:42.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.625+0000 7ffab57fa700 1 -- 172.21.15.26:0/2927364068 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac005c6c0 con 0x55c3b06cf840 2023-09-28T00:15:42.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.625+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/2927364068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 msgr2=0x55c3b06cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.625+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06cfc10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ffac0082ef0 tx=0x7ffac0082e80 comp rx=0 tx=0).stop 2023-09-28T00:15:42.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.626+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/2927364068 shutdown_connections 2023-09-28T00:15:42.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.626+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b071fc00 0x55c3b0720050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.626+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06cfc10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.626+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/2927364068 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b06d0cc0 0x55c3b071f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.626+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/2927364068 >> 172.21.15.26:0/2927364068 conn(0x55c3b06d1160 msgr2=0x55c3b06d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:42.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.626+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/2927364068 shutdown_connections 2023-09-28T00:15:42.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.626+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/2927364068 wait complete. 2023-09-28T00:15:42.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.626+0000 7ffadfc7eb80 1 -- start start 2023-09-28T00:15:42.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.626+0000 7ffadfc7eb80 1 Processor -- start 2023-09-28T00:15:42.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06d0cc0 0x55c3b0712240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b06f9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3b05cb890 con 0x55c3b06cf840 2023-09-28T00:15:42.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3b05e6ea0 con 0x55c3b06d0cc0 2023-09-28T00:15:42.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3b04a2e30 con 0x55c3b071fc00 2023-09-28T00:15:42.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffadfc7eb80 10 client.0 _ll_register_callbacks cb 0x55c3b0692e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:15:42.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06e53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40004/0 (socket says 172.21.15.26:40004) 2023-09-28T00:15:42.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacffff700 1 -- 172.21.15.26:0/1537682682 learned_addr learned my addr 172.21.15.26:0/1537682682 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:42.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06d0cc0 0x55c3b0712240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffad4f25700 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b06f9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacffff700 1 -- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 msgr2=0x55c3b06f9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:42.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacffff700 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b06f9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacffff700 1 -- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06d0cc0 msgr2=0x55c3b0712240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:42.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacffff700 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06d0cc0 0x55c3b0712240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacffff700 1 -- 172.21.15.26:0/1537682682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad00c8ce0 con 0x55c3b06cf840 2023-09-28T00:15:42.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06d0cc0 0x55c3b0712240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:42.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffacffff700 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06e53b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffac000afd0 tx=0x7ffac0080000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e5619edd44fe5d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:42.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.627+0000 7ffaae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-09-28T00:15:42.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1537682682 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac005c440 con 0x55c3b06cf840 2023-09-28T00:15:42.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1537682682 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffac0051510 con 0x55c3b06cf840 2023-09-28T00:15:42.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1537682682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c3b06c4940 con 0x55c3b06cf840 2023-09-28T00:15:42.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1537682682 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffac0071200 con 0x55c3b06cf840 2023-09-28T00:15:42.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffadfc7eb80 10 client.4623 fetch_fsmap learned FSMap version 8 2023-09-28T00:15:42.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1537682682 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c3b045cfe0 con 0x55c3b06cf840 2023-09-28T00:15:42.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1537682682 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c3b06c4940 con 0x55c3b06cf840 2023-09-28T00:15:42.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1537682682 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffac0071360 con 0x55c3b06cf840 2023-09-28T00:15:42.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffadfc7eb80 10 client.4623 fetch_fsmap finished waiting for FSMap version 8 2023-09-28T00:15:42.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffadfc7eb80 10 client.4623 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-28T00:15:42.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffadfc7eb80 20 client.4623 populate_metadata read hostname 'smithi026' 2023-09-28T00:15:42.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] conn(0x55c3b07169b0 0x55c3b0716d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffadfc7eb80 4 client.4623 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-28T00:15:42.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1537682682 --> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3b06a1870 con 0x55c3b07169b0 2023-09-28T00:15:42.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.628+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] conn(0x55c3b07169b0 0x55c3b0716d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.629+0000 7ffaae7fc700 10 client.4623 ms_handle_connect on v2:172.21.15.190:6835/3098279304 2023-09-28T00:15:42.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.629+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] conn(0x55c3b07169b0 0x55c3b0716d80 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8432869811a64c8 server_cookie=4e383574df9ba9a7 in_seq=0 out_seq=0 2023-09-28T00:15:42.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.629+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1537682682 <== mds.0 v2:172.21.15.190:6835/3098279304 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c3b06a1870 con 0x55c3b07169b0 2023-09-28T00:15:42.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.629+0000 7ffaae7fc700 10 client.4623 handle_command_reply: tid=0 2023-09-28T00:15:42.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.629+0000 7ffadfc7eb80 1 client.4623 shutdown 2023-09-28T00:15:42.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.629+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1537682682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 msgr2=0x55c3b06e53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.629+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06e53b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffac000afd0 tx=0x7ffac0080000 comp rx=0 tx=0).stop 2023-09-28T00:15:42.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1537682682 shutdown_connections 2023-09-28T00:15:42.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] conn(0x55c3b07169b0 0x55c3b0716d80 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b06f9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffaae7fc700 0 client.4623 ms_handle_reset on v2:172.21.15.190:6835/3098279304 2023-09-28T00:15:42.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06cf840 0x55c3b06e53b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1537682682 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06d0cc0 0x55c3b0712240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1537682682 >> 172.21.15.26:0/1537682682 conn(0x55c3b06d1160 msgr2=0x55c3b06f8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:42.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1537682682 shutdown_connections 2023-09-28T00:15:42.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1537682682 wait complete. 2023-09-28T00:15:42.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.630+0000 7ffadfc7eb80 20 client.4623 trim_cache size 0 max 16384 2023-09-28T00:15:42.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.647+0000 7ffadfc7eb80 1 Processor -- start 2023-09-28T00:15:42.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.647+0000 7ffadfc7eb80 1 -- start start 2023-09-28T00:15:42.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.647+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 0x55c3b0715900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.647+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b0710370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.647+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b07141b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.647+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3b06e5420 con 0x55c3b06d0cc0 2023-09-28T00:15:42.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.647+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3b07146f0 con 0x55c3b06cf840 2023-09-28T00:15:42.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.647+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3b07377a0 con 0x55c3b071fc00 2023-09-28T00:15:42.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b0710370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b0710370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40010/0 (socket says 172.21.15.26:40010) 2023-09-28T00:15:42.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacf7fe700 1 -- 172.21.15.26:0/3839396489 learned_addr learned my addr 172.21.15.26:0/3839396489 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:42.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacffff700 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 0x55c3b0715900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffad4f25700 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b07141b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacf7fe700 1 -- 172.21.15.26:0/3839396489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 msgr2=0x55c3b07141b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:42.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b07141b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacf7fe700 1 -- 172.21.15.26:0/3839396489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 msgr2=0x55c3b0715900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:42.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 0x55c3b0715900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacf7fe700 1 -- 172.21.15.26:0/3839396489 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3b06cace0 con 0x55c3b06d0cc0 2023-09-28T00:15:42.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacffff700 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 0x55c3b0715900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:42.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b0710370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffac40030c0 tx=0x7ffac4032250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b64d881ddf137adc server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:42.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffab5ffb700 1 -- 172.21.15.26:0/3839396489 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4030070 con 0x55c3b06d0cc0 2023-09-28T00:15:42.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffab5ffb700 1 -- 172.21.15.26:0/3839396489 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac402bdb0 con 0x55c3b06d0cc0 2023-09-28T00:15:42.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.648+0000 7ffab5ffb700 1 -- 172.21.15.26:0/3839396489 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac401c440 con 0x55c3b06d0cc0 2023-09-28T00:15:42.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/3839396489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 msgr2=0x55c3b0710370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b0710370 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ffac40030c0 tx=0x7ffac4032250 comp rx=0 tx=0).stop 2023-09-28T00:15:42.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/3839396489 shutdown_connections 2023-09-28T00:15:42.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b07141b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 0x55c3b0715900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/3839396489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b0710370 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/3839396489 >> 172.21.15.26:0/3839396489 conn(0x55c3b06d1160 msgr2=0x55c3b06c8280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:42.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/3839396489 shutdown_connections 2023-09-28T00:15:42.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/3839396489 wait complete. 2023-09-28T00:15:42.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 -- start start 2023-09-28T00:15:42.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.649+0000 7ffadfc7eb80 1 Processor -- start 2023-09-28T00:15:42.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 0x55c3b077adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b077bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffadfc7eb80 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b06cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3b06cc760 con 0x55c3b06d0cc0 2023-09-28T00:15:42.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3b06d1e70 con 0x55c3b06cf840 2023-09-28T00:15:42.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffadfc7eb80 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3b077b900 con 0x55c3b071fc00 2023-09-28T00:15:42.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffadfc7eb80 10 client.0 _ll_register_callbacks cb 0x55c3b0692e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-28T00:15:42.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffacf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b077bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffacf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b077bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40024/0 (socket says 172.21.15.26:40024) 2023-09-28T00:15:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffacf7fe700 1 -- 172.21.15.26:0/1752533688 learned_addr learned my addr 172.21.15.26:0/1752533688 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffacffff700 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 0x55c3b077adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.650+0000 7ffad4f25700 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b06cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffacf7fe700 1 -- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 msgr2=0x55c3b06cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b06cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffacf7fe700 1 -- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 msgr2=0x55c3b077adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 0x55c3b077adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffacf7fe700 1 -- 172.21.15.26:0/1752533688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac4022070 con 0x55c3b06d0cc0 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffacf7fe700 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b077bd90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffac4003010 tx=0x7ffac402d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e2902201406130 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffaae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1752533688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4030050 con 0x55c3b06d0cc0 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1752533688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffac401ca00 con 0x55c3b06d0cc0 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1752533688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffac0058970 con 0x55c3b06d0cc0 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1752533688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffac401cdd0 con 0x55c3b06d0cc0 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffadfc7eb80 10 client.4629 fetch_fsmap learned FSMap version 8 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1752533688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c3b05ee780 con 0x55c3b06d0cc0 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1752533688 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac0058970 con 0x55c3b06d0cc0 2023-09-28T00:15:42.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1752533688 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffac4035430 con 0x55c3b06d0cc0 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffadfc7eb80 10 client.4629 fetch_fsmap finished waiting for FSMap version 8 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffadfc7eb80 10 client.4629 resolve_mds: resolved name 'd' to daemon mds.d 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffadfc7eb80 20 client.4629 populate_metadata read hostname 'smithi026' 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] conn(0x55c3b0716d80 0x55c3b0717150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffadfc7eb80 4 client.4629 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.651+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1752533688 --> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c3b05c2e00 con 0x55c3b0716d80 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffacffff700 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] conn(0x55c3b0716d80 0x55c3b0717150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffaae7fc700 10 client.4629 ms_handle_connect on v2:172.21.15.190:6835/3098279304 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffacffff700 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] conn(0x55c3b0716d80 0x55c3b0717150 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1da131b20d09a5b server_cookie=24bcabf42a883983 in_seq=0 out_seq=0 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffaae7fc700 1 -- 172.21.15.26:0/1752533688 <== mds.0 v2:172.21.15.190:6835/3098279304 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c3b05c2e00 con 0x55c3b0716d80 2023-09-28T00:15:42.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffaae7fc700 10 client.4629 handle_command_reply: tid=0 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 client.4629 shutdown 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1752533688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 msgr2=0x55c3b077bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b077bd90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffac4003010 tx=0x7ffac402d070 comp rx=0 tx=0).stop 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1752533688 shutdown_connections 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:6835/3098279304,v1:172.21.15.190:6837/3098279304] conn(0x55c3b0716d80 0x55c3b0717150 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55c3b071fc00 0x55c3b06cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffaae7fc700 0 client.4629 ms_handle_reset on v2:172.21.15.190:6835/3098279304 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55c3b06cf840 0x55c3b077adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 --2- 172.21.15.26:0/1752533688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c3b06d0cc0 0x55c3b077bd90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1752533688 >> 172.21.15.26:0/1752533688 conn(0x55c3b06d1160 msgr2=0x55c3b0728770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:42.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1752533688 shutdown_connections 2023-09-28T00:15:42.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 1 -- 172.21.15.26:0/1752533688 wait complete. 2023-09-28T00:15:42.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.652+0000 7ffadfc7eb80 20 client.4629 trim_cache size 0 max 16384 2023-09-28T00:15:42.669 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-09-28T00:15:42.669 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6", 2023-09-28T00:15:42.669 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-09-28T00:15:42.669 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4300, 2023-09-28T00:15:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-09-28T00:15:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-09-28T00:15:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-09-28T00:15:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 13.279062884, 2023-09-28T00:15:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 8, 2023-09-28T00:15:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 24, 2023-09-28T00:15:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 24, 2023-09-28T00:15:42.670 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 18.601617897000001 2023-09-28T00:15:42.670 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-09-28T00:15:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 -- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffabc067330 msgr2=0x7ffabc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffabc067330 0x7ffabc0697e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffad00ad680 tx=0x7ffac4017000 comp rx=0 tx=0).stop 2023-09-28T00:15:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 -- 172.21.15.26:0/189426274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b1690 msgr2=0x7ffad0144be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b1690 0x7ffad0144be0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ffac000c850 tx=0x7ffac0008040 comp rx=0 tx=0).stop 2023-09-28T00:15:42.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 -- 172.21.15.26:0/189426274 shutdown_connections 2023-09-28T00:15:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ffabc067330 0x7ffabc0697e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffad015cb10 0x7ffad015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffad00b1690 0x7ffad0144be0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 --2- 172.21.15.26:0/189426274 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffad00b4000 0x7ffad0159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 -- 172.21.15.26:0/189426274 >> 172.21.15.26:0/189426274 conn(0x7ffad006d890 msgr2=0x7ffad00ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 -- 172.21.15.26:0/189426274 shutdown_connections 2023-09-28T00:15:42.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:42.653+0000 7ffad6988700 1 -- 172.21.15.26:0/189426274 wait complete. 2023-09-28T00:15:42.674 INFO:teuthology.run_tasks:Running task kclient... 2023-09-28T00:15:42.695 INFO:tasks.kclient:Mounting kernel clients... 2023-09-28T00:15:42.695 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-09-28T00:15:42.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:42.696 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-09-28T00:15:42.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:42.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-09-28T00:15:42.778 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2023-09-28T00:15:42.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:15:42.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:42.780 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-09-28T00:15:42.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:42.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-09-28T00:15:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2023-09-28T00:15:42.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:15:42.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:42.902 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-09-28T00:15:42.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:42.921 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-09-28T00:15:42.991 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2023-09-28T00:15:42.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:15:42.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:42.993 DEBUG:teuthology.orchestra.run.smithi190:> ip netns list 2023-09-28T00:15:43.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:43.050 DEBUG:teuthology.orchestra.run.smithi190:> sudo ip link delete ceph-brx 2023-09-28T00:15:43.118 INFO:teuthology.orchestra.run.smithi190.stderr:Cannot find device "ceph-brx" 2023-09-28T00:15:43.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:15:43.119 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-09-28T00:15:43.120 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-28T00:15:43.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.239+0000 7f4ce3542700 1 Processor -- start 2023-09-28T00:15:43.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.239+0000 7f4ce3542700 1 -- start start 2023-09-28T00:15:43.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce3542700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4cdc15d560 0x7f4cdc0d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:43.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce3542700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:43.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce3542700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc0b2ad0 con 0x7f4cdc15d930 2023-09-28T00:15:43.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce3542700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc0b4160 con 0x7f4cdc15d560 2023-09-28T00:15:43.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce3542700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc159b70 con 0x7f4cdc1591b0 2023-09-28T00:15:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce1adf700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce1adf700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:41286/0 (socket says 172.21.15.26:41286) 2023-09-28T00:15:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce1adf700 1 -- 172.21.15.26:0/3351492983 learned_addr learned my addr 172.21.15.26:0/3351492983 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce12de700 1 --2- 172.21.15.26:0/3351492983 >> v2:172.21.15.190:3300/0 conn(0x7f4cdc15d560 0x7f4cdc0d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce1adf700 1 -- 172.21.15.26:0/3351492983 >> v2:172.21.15.190:3300/0 conn(0x7f4cdc15d560 msgr2=0x7f4cdc0d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:43.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce1adf700 1 --2- 172.21.15.26:0/3351492983 >> v2:172.21.15.190:3300/0 conn(0x7f4cdc15d560 0x7f4cdc0d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce1adf700 1 -- 172.21.15.26:0/3351492983 >> v1:172.21.15.190:6789/0 conn(0x7f4cdc15d930 legacy=0x7f4cdc0b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce1adf700 1 -- 172.21.15.26:0/3351492983 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0b2230 con 0x7f4cdc1591b0 2023-09-28T00:15:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.240+0000 7f4ce12de700 1 --2- 172.21.15.26:0/3351492983 >> v2:172.21.15.190:3300/0 conn(0x7f4cdc15d560 0x7f4cdc0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4ce1adf700 1 --2- 172.21.15.26:0/3351492983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009f20 tx=0x7f4ccc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14bad171972df639 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4cdbfff700 1 -- 172.21.15.26:0/3351492983 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc00e070 con 0x7f4cdc1591b0 2023-09-28T00:15:43.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4cdbfff700 1 -- 172.21.15.26:0/3351492983 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc00b9d0 con 0x7f4cdc1591b0 2023-09-28T00:15:43.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4cdbfff700 1 -- 172.21.15.26:0/3351492983 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0092e0 con 0x7f4cdc1591b0 2023-09-28T00:15:43.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4ce3542700 1 -- 172.21.15.26:0/3351492983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 msgr2=0x7f4cdc159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:43.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4ce3542700 1 --2- 172.21.15.26:0/3351492983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc009f20 tx=0x7f4ccc009840 comp rx=0 tx=0).stop 2023-09-28T00:15:43.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4ce3542700 1 -- 172.21.15.26:0/3351492983 shutdown_connections 2023-09-28T00:15:43.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4ce3542700 1 --2- 172.21.15.26:0/3351492983 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4ce3542700 1 --2- 172.21.15.26:0/3351492983 >> v2:172.21.15.190:3300/0 conn(0x7f4cdc15d560 0x7f4cdc0d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4ce3542700 1 -- 172.21.15.26:0/3351492983 >> 172.21.15.26:0/3351492983 conn(0x7f4cdc0d1180 msgr2=0x7f4cdc069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:43.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4ce3542700 1 -- 172.21.15.26:0/3351492983 shutdown_connections 2023-09-28T00:15:43.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.241+0000 7f4ce3542700 1 -- 172.21.15.26:0/3351492983 wait complete. 2023-09-28T00:15:43.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.242+0000 7f4ce3542700 1 Processor -- start 2023-09-28T00:15:43.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.243+0000 7f4ce3542700 1 -- start start 2023-09-28T00:15:43.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.243+0000 7f4ce3542700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:43.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.243+0000 7f4ce3542700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cdc15d560 0x7f4cdc147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:43.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.243+0000 7f4ce3542700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cdc15d930 0x7f4cdc1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:43.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.243+0000 7f4ce3542700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc15b040 con 0x7f4cdc15d930 2023-09-28T00:15:43.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.243+0000 7f4ce3542700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc15a280 con 0x7f4cdc15d560 2023-09-28T00:15:43.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.243+0000 7f4ce3542700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc147680 con 0x7f4cdc1591b0 2023-09-28T00:15:43.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.243+0000 7f4ce1adf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cdc15d930 0x7f4cdc1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:43.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce1adf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cdc15d930 0x7f4cdc1575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40030/0 (socket says 172.21.15.26:40030) 2023-09-28T00:15:43.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce1adf700 1 -- 172.21.15.26:0/4171378488 learned_addr learned my addr 172.21.15.26:0/4171378488 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:43.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce12de700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:43.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce0add700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cdc15d560 0x7f4cdc147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:43.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce1adf700 1 -- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 msgr2=0x7f4cdc159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:43.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce1adf700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce1adf700 1 -- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cdc15d560 msgr2=0x7f4cdc147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:43.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce1adf700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cdc15d560 0x7f4cdc147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce1adf700 1 -- 172.21.15.26:0/4171378488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4009420 con 0x7f4cdc15d930 2023-09-28T00:15:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce1adf700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cdc15d930 0x7f4cdc1575e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc159cb0 tx=0x7f4ccc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4cd97fa700 1 -- 172.21.15.26:0/4171378488 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0094e0 con 0x7f4cdc15d930 2023-09-28T00:15:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4cd97fa700 1 -- 172.21.15.26:0/4171378488 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc008b10 con 0x7f4cdc15d930 2023-09-28T00:15:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc009ae0 con 0x7f4cdc15d930 2023-09-28T00:15:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4cd97fa700 1 -- 172.21.15.26:0/4171378488 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc026460 con 0x7f4cdc15d930 2023-09-28T00:15:43.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.244+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc15a7c0 con 0x7f4cdc15d930 2023-09-28T00:15:43.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.245+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc064050 con 0x7f4cdc15d930 2023-09-28T00:15:43.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.246+0000 7f4cd97fa700 1 -- 172.21.15.26:0/4171378488 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f4ccc003040 con 0x7f4cdc15d930 2023-09-28T00:15:43.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.246+0000 7f4cd97fa700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4cc8067360 0x7f4cc8069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:43.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.246+0000 7f4cd97fa700 1 -- 172.21.15.26:0/4171378488 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ccc086d90 con 0x7f4cdc15d930 2023-09-28T00:15:43.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.246+0000 7f4ce12de700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4cc8067360 0x7f4cc8069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:43.253 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.247+0000 7f4ce12de700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4cc8067360 0x7f4cc8069810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009f40 tx=0x7f4cd40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:43.254 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.250+0000 7f4cd97fa700 1 -- 172.21.15.26:0/4171378488 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f4ccc053c90 con 0x7f4cdc15d930 2023-09-28T00:15:43.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.488+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4cdc0b3b50 con 0x7f4cdc15d930 2023-09-28T00:15:43.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.489+0000 7f4cd97fa700 1 -- 172.21.15.26:0/4171378488 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4ccc021070 con 0x7f4cdc15d930 2023-09-28T00:15:43.490 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-28T00:15:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.490+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4cc8067360 msgr2=0x7f4cc8069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.490+0000 7f4ce3542700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4cc8067360 0x7f4cc8069810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009f40 tx=0x7f4cd40091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cdc15d930 msgr2=0x7f4cdc1575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cdc15d930 0x7f4cdc1575e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc159cb0 tx=0x7f4ccc018000 comp rx=0 tx=0).stop 2023-09-28T00:15:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 shutdown_connections 2023-09-28T00:15:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f4cc8067360 0x7f4cc8069810 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4cdc1591b0 0x7f4cdc159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cdc15d930 0x7f4cdc1575e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 --2- 172.21.15.26:0/4171378488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4cdc15d560 0x7f4cdc147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:43.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 >> 172.21.15.26:0/4171378488 conn(0x7f4cdc0d1180 msgr2=0x7f4cdc067e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:43.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 shutdown_connections 2023-09-28T00:15:43.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:43.491+0000 7f4ce3542700 1 -- 172.21.15.26:0/4171378488 wait complete. 2023-09-28T00:15:43.504 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-28T00:15:43.504 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-28T00:15:43.504 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-09-28T00:15:43.504 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-28T00:15:43.504 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-28T00:15:43.504 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-28T00:15:43.504 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-28T00:15:43.504 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-28T00:15:43.504 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-28T00:15:43.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:43.505 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2023-09-28T00:15:43.520 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42485sec preferred_lft 42485sec 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-28T00:15:43.521 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-09-28T00:15:43.522 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2023-09-28T00:15:43.522 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-28T00:15:43.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:43.522 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-09-28T00:15:43.522 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-09-28T00:15:43.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2023-09-28T00:15:43.523 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2023-09-28T00:15:43.523 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2023-09-28T00:15:43.523 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-28T00:15:43.523 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-09-28T00:15:43.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:43.685 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-28T00:15:43.727 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-09-28T00:15:43.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:43.728 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-09-28T00:15:43.797 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-09-28T00:15:43.797 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-28T00:15:43.797 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-09-28T00:15:43.797 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-09-28T00:15:43.797 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-28T00:15:43.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:43.798 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-09-28T00:15:43.798 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-09-28T00:15:43.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-28T00:15:43.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-28T00:15:43.798 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-28T00:15:43.798 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-09-28T00:15:44.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:44.058 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-09-28T00:15:44.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:44.073 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-09-28T00:15:44.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:44.127 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-09-28T00:15:44.127 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-09-28T00:15:44.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-28T00:15:44.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-28T00:15:44.128 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-09-28T00:15:44.219 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-28T00:15:44.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:44.219 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-09-28T00:15:44.220 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-09-28T00:15:44.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-28T00:15:44.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-28T00:15:44.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-28T00:15:44.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-28T00:15:44.220 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-28T00:15:44.220 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-09-28T00:15:44.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-28T00:15:44.407 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-09-28T00:15:44.407 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-09-28T00:15:44.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-09-28T00:15:44.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2023-09-28T00:15:44.408 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-09-28T00:15:44.501 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-28T00:15:44.501 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-28T00:15:44.516 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-28T00:15:44.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-28T00:15:44.517 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-28T00:15:44.571 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/kclient.py", line 112, in task kernel_mount.mount(mntopts=client_config.get('mntopts', [])) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 54, in mount retval = self._run_mount_cmd(mntopts, check_status) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 69, in _run_mount_cmd mount_cmd = self._get_mount_cmd(mntopts) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 118, in _get_mount_cmd stx_opt = self._make_mount_cmd_old_or_new_style() File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 91, in _make_mount_cmd_old_or_new_style assert(self.cephfs_mntpt) AssertionError 2023-09-28T00:15:44.638 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=796a07e2640b4a498dc496114abb9f4f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/kclient.py", line 112, in task kernel_mount.mount(mntopts=client_config.get('mntopts', [])) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 54, in mount retval = self._run_mount_cmd(mntopts, check_status) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 69, in _run_mount_cmd mount_cmd = self._get_mount_cmd(mntopts) File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 118, in _get_mount_cmd stx_opt = self._make_mount_cmd_old_or_new_style() File "/home/teuthworker/src/github.com_ceph_ceph-c_471b6dfd2d990acf7f03e5d073b84a1b39d1ad28/qa/tasks/cephfs/kernel_mount.py", line 91, in _make_mount_cmd_old_or_new_style assert(self.cephfs_mntpt) AssertionError 2023-09-28T00:15:44.640 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-09-28T00:15:44.650 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-28T00:15:44.657 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-09-28T00:15:44.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:44.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.789+0000 7f75e629c700 1 Processor -- start 2023-09-28T00:15:44.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.789+0000 7f75e629c700 1 -- start start 2023-09-28T00:15:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.790+0000 7f75e629c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75e0068640 0x7f75e0068a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.790+0000 7f75e629c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00b0920 con 0x7f75e00ac340 2023-09-28T00:15:44.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.790+0000 7f75e629c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e00abeb0 con 0x7f75e01501f0 2023-09-28T00:15:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.790+0000 7f75e629c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e0068fd0 con 0x7f75e0068640 2023-09-28T00:15:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.790+0000 7f75df7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f75e0068640 0x7f75e0068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.790+0000 7f75e4839700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f75e00ac340 0x7f75e00ac760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49234/0 (socket says 172.21.15.26:49234) 2023-09-28T00:15:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.790+0000 7f75e4839700 1 -- 172.21.15.26:0/46169844 learned_addr learned my addr 172.21.15.26:0/46169844 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.791+0000 7f75deffd700 1 -- 172.21.15.26:0/46169844 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3253188254 0 0) 0x7f75e00b0920 con 0x7f75e00ac340 2023-09-28T00:15:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.791+0000 7f75deffd700 1 -- 172.21.15.26:0/46169844 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75c8003570 con 0x7f75e00ac340 2023-09-28T00:15:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.791+0000 7f75df7fe700 1 -- 172.21.15.26:0/46169844 >> v1:172.21.15.190:6789/0 conn(0x7f75e01501f0 legacy=0x7f75e00ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:44.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.791+0000 7f75df7fe700 1 -- 172.21.15.26:0/46169844 >> v1:172.21.15.26:6789/0 conn(0x7f75e00ac340 legacy=0x7f75e00ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.791+0000 7f75df7fe700 1 -- 172.21.15.26:0/46169844 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e00b0640 con 0x7f75e0068640 2023-09-28T00:15:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.791+0000 7f75df7fe700 1 --2- 172.21.15.26:0/46169844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0068640 0x7f75e0068a90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098e0 tx=0x7f75d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69c1f1ead11ab0f server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.791+0000 7f75deffd700 1 -- 172.21.15.26:0/46169844 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d400f6b0 con 0x7f75e0068640 2023-09-28T00:15:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.791+0000 7f75deffd700 1 -- 172.21.15.26:0/46169844 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d400f810 con 0x7f75e0068640 2023-09-28T00:15:44.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.791+0000 7f75deffd700 1 -- 172.21.15.26:0/46169844 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d400fbb0 con 0x7f75e0068640 2023-09-28T00:15:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.792+0000 7f75e629c700 1 -- 172.21.15.26:0/46169844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0068640 msgr2=0x7f75e0068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:44.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.792+0000 7f75e629c700 1 --2- 172.21.15.26:0/46169844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0068640 0x7f75e0068a90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f75d40098e0 tx=0x7f75d40091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.792+0000 7f75e629c700 1 -- 172.21.15.26:0/46169844 shutdown_connections 2023-09-28T00:15:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.792+0000 7f75e629c700 1 --2- 172.21.15.26:0/46169844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e0068640 0x7f75e0068a90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.792+0000 7f75e629c700 1 -- 172.21.15.26:0/46169844 >> 172.21.15.26:0/46169844 conn(0x7f75e00ccd30 msgr2=0x7f75e00694b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.792+0000 7f75e629c700 1 -- 172.21.15.26:0/46169844 shutdown_connections 2023-09-28T00:15:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.792+0000 7f75e629c700 1 -- 172.21.15.26:0/46169844 wait complete. 2023-09-28T00:15:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.793+0000 7f75e629c700 1 Processor -- start 2023-09-28T00:15:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.793+0000 7f75e629c700 1 -- start start 2023-09-28T00:15:44.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e629c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75e0068640 0x7f75e00ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e629c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75e00ac340 0x7f75e014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e629c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e01501f0 0x7f75e0165500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e629c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00ca8d0 con 0x7f75e01501f0 2023-09-28T00:15:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e629c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00c9f00 con 0x7f75e0068640 2023-09-28T00:15:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e629c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00c98d0 con 0x7f75e00ac340 2023-09-28T00:15:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e4839700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e01501f0 0x7f75e0165500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:44.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e4839700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e01501f0 0x7f75e0165500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40052/0 (socket says 172.21.15.26:40052) 2023-09-28T00:15:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e4839700 1 -- 172.21.15.26:0/2781552251 learned_addr learned my addr 172.21.15.26:0/2781552251 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75dffff700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75e0068640 0x7f75e00ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75df7fe700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75e00ac340 0x7f75e014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e4839700 1 -- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75e00ac340 msgr2=0x7f75e014ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e4839700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75e00ac340 0x7f75e014ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e4839700 1 -- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75e0068640 msgr2=0x7f75e00ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:44.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e4839700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75e0068640 0x7f75e00ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e4839700 1 -- 172.21.15.26:0/2781552251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4009420 con 0x7f75e01501f0 2023-09-28T00:15:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75df7fe700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75e00ac340 0x7f75e014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.794+0000 7f75e4839700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e01501f0 0x7f75e0165500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75d8001460 tx=0x7f75d8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.795+0000 7f75c7fff700 1 -- 172.21.15.26:0/2781552251 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800a940 con 0x7f75e01501f0 2023-09-28T00:15:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.795+0000 7f75c7fff700 1 -- 172.21.15.26:0/2781552251 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d800aaa0 con 0x7f75e01501f0 2023-09-28T00:15:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.795+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e0166030 con 0x7f75e01501f0 2023-09-28T00:15:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.795+0000 7f75c7fff700 1 -- 172.21.15.26:0/2781552251 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d800ae20 con 0x7f75e01501f0 2023-09-28T00:15:44.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.795+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e00c9b90 con 0x7f75e01501f0 2023-09-28T00:15:44.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.796+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e00ca070 con 0x7f75e01501f0 2023-09-28T00:15:44.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.796+0000 7f75c7fff700 1 -- 172.21.15.26:0/2781552251 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f75d8007300 con 0x7f75e01501f0 2023-09-28T00:15:44.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.796+0000 7f75c7fff700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f75cc067330 0x7f75cc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:44.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.796+0000 7f75c7fff700 1 -- 172.21.15.26:0/2781552251 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f75d8085020 con 0x7f75e01501f0 2023-09-28T00:15:44.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.797+0000 7f75dffff700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f75cc067330 0x7f75cc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:44.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.797+0000 7f75dffff700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f75cc067330 0x7f75cc0697e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f75d00039e0 tx=0x7f75d0007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:44.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.801+0000 7f75c7fff700 1 -- 172.21.15.26:0/2781552251 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f75d8051f10 con 0x7f75e01501f0 2023-09-28T00:15:44.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.998+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75e00ab860 con 0x7f75e01501f0 2023-09-28T00:15:45.000 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:44.999+0000 7f75c7fff700 1 -- 172.21.15.26:0/2781552251 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f75d8055530 con 0x7f75e01501f0 2023-09-28T00:15:45.000 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:45.001 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:30.373905+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f75cc067330 msgr2=0x7f75cc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.002 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f75cc067330 0x7f75cc0697e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f75d00039e0 tx=0x7f75d0007ec0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e01501f0 msgr2=0x7f75e0165500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e01501f0 0x7f75e0165500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f75d8001460 tx=0x7f75d8001ae0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 shutdown_connections 2023-09-28T00:15:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f75cc067330 0x7f75cc0697e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f75e01501f0 0x7f75e0165500 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f75e0068640 0x7f75e00ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 --2- 172.21.15.26:0/2781552251 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f75e00ac340 0x7f75e014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 >> 172.21.15.26:0/2781552251 conn(0x7f75e00ccd30 msgr2=0x7f75e00ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:45.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 shutdown_connections 2023-09-28T00:15:45.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.001+0000 7f75e629c700 1 -- 172.21.15.26:0/2781552251 wait complete. 2023-09-28T00:15:45.014 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-28T00:15:45.015 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:15:45.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.133+0000 7fb586b15700 1 Processor -- start 2023-09-28T00:15:45.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.133+0000 7fb586b15700 1 -- start start 2023-09-28T00:15:45.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.133+0000 7fb586b15700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb580157400 0x7fb5801577d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.133+0000 7fb586b15700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb580068ed0 0x7fb5800692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.133+0000 7fb586b15700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5800cada0 con 0x7fb58006a820 2023-09-28T00:15:45.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.133+0000 7fb586b15700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58006f130 con 0x7fb580068ed0 2023-09-28T00:15:45.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.133+0000 7fb586b15700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb580069820 con 0x7fb580157400 2023-09-28T00:15:45.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb5850b2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb580068ed0 0x7fb5800692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb5850b2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb580068ed0 0x7fb5800692e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40060/0 (socket says 172.21.15.26:40060) 2023-09-28T00:15:45.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb5850b2700 1 -- 172.21.15.26:0/442747633 learned_addr learned my addr 172.21.15.26:0/442747633 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:45.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb5848b1700 1 --2- 172.21.15.26:0/442747633 >> v2:172.21.15.190:3300/0 conn(0x7fb580157400 0x7fb5801577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb5850b2700 1 -- 172.21.15.26:0/442747633 >> v2:172.21.15.190:3300/0 conn(0x7fb580157400 msgr2=0x7fb5801577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:45.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb5850b2700 1 --2- 172.21.15.26:0/442747633 >> v2:172.21.15.190:3300/0 conn(0x7fb580157400 0x7fb5801577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb5850b2700 1 -- 172.21.15.26:0/442747633 >> v1:172.21.15.190:6789/0 conn(0x7fb58006a820 legacy=0x7fb58006ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb5850b2700 1 -- 172.21.15.26:0/442747633 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58006acc0 con 0x7fb580068ed0 2023-09-28T00:15:45.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb5850b2700 1 --2- 172.21.15.26:0/442747633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb580068ed0 0x7fb5800692e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb58006da20 tx=0x7fb568009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43c7c7b8d32fadc server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:45.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb57f7fe700 1 -- 172.21.15.26:0/442747633 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800b860 con 0x7fb580068ed0 2023-09-28T00:15:45.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb57f7fe700 1 -- 172.21.15.26:0/442747633 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56800b9c0 con 0x7fb580068ed0 2023-09-28T00:15:45.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.134+0000 7fb57f7fe700 1 -- 172.21.15.26:0/442747633 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800bd60 con 0x7fb580068ed0 2023-09-28T00:15:45.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.135+0000 7fb586b15700 1 -- 172.21.15.26:0/442747633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb580068ed0 msgr2=0x7fb5800692e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.135+0000 7fb586b15700 1 --2- 172.21.15.26:0/442747633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb580068ed0 0x7fb5800692e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb58006da20 tx=0x7fb568009250 comp rx=0 tx=0).stop 2023-09-28T00:15:45.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.135+0000 7fb586b15700 1 -- 172.21.15.26:0/442747633 shutdown_connections 2023-09-28T00:15:45.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.135+0000 7fb586b15700 1 --2- 172.21.15.26:0/442747633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb580068ed0 0x7fb5800692e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.135+0000 7fb586b15700 1 --2- 172.21.15.26:0/442747633 >> v2:172.21.15.190:3300/0 conn(0x7fb580157400 0x7fb5801577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.135+0000 7fb586b15700 1 -- 172.21.15.26:0/442747633 >> 172.21.15.26:0/442747633 conn(0x7fb5800c9fc0 msgr2=0x7fb58006de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:45.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.135+0000 7fb586b15700 1 -- 172.21.15.26:0/442747633 shutdown_connections 2023-09-28T00:15:45.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.135+0000 7fb586b15700 1 -- 172.21.15.26:0/442747633 wait complete. 2023-09-28T00:15:45.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.136+0000 7fb586b15700 1 Processor -- start 2023-09-28T00:15:45.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.136+0000 7fb586b15700 1 -- start start 2023-09-28T00:15:45.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb586b15700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb580068ed0 0x7fb5800ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb586b15700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb58006a820 0x7fb580152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb586b15700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb580157400 0x7fb5800b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb586b15700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb580153490 con 0x7fb58006a820 2023-09-28T00:15:45.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb586b15700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800b2360 con 0x7fb580068ed0 2023-09-28T00:15:45.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb586b15700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800b2640 con 0x7fb580157400 2023-09-28T00:15:45.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb58006a820 0x7fb580152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb58006a820 0x7fb580152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40076/0 (socket says 172.21.15.26:40076) 2023-09-28T00:15:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57ffff700 1 -- 172.21.15.26:0/131391936 learned_addr learned my addr 172.21.15.26:0/131391936 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb5848b1700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb580068ed0 0x7fb5800ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb5850b2700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb580157400 0x7fb5800b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57ffff700 1 -- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb580157400 msgr2=0x7fb5800b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57ffff700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb580157400 0x7fb5800b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57ffff700 1 -- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb580068ed0 msgr2=0x7fb5800ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57ffff700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb580068ed0 0x7fb5800ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57ffff700 1 -- 172.21.15.26:0/131391936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5680094f0 con 0x7fb58006a820 2023-09-28T00:15:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb5848b1700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb580068ed0 0x7fb5800ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57ffff700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb58006a820 0x7fb580152f50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb57000cb10 tx=0x7fb5700017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57cff9700 1 -- 172.21.15.26:0/131391936 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570006ba0 con 0x7fb58006a820 2023-09-28T00:15:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57cff9700 1 -- 172.21.15.26:0/131391936 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb570006d00 con 0x7fb58006a820 2023-09-28T00:15:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5800c3ca0 con 0x7fb58006a820 2023-09-28T00:15:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.137+0000 7fb57cff9700 1 -- 172.21.15.26:0/131391936 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57000a9b0 con 0x7fb58006a820 2023-09-28T00:15:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.138+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5800c4260 con 0x7fb58006a820 2023-09-28T00:15:45.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.138+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5800c4480 con 0x7fb58006a820 2023-09-28T00:15:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.139+0000 7fb57cff9700 1 -- 172.21.15.26:0/131391936 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb570012420 con 0x7fb58006a820 2023-09-28T00:15:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.139+0000 7fb57cff9700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb560067330 0x7fb5600697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.140+0000 7fb57cff9700 1 -- 172.21.15.26:0/131391936 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb570084aa0 con 0x7fb58006a820 2023-09-28T00:15:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.140+0000 7fb5848b1700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb560067330 0x7fb5600697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.140+0000 7fb5848b1700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb560067330 0x7fb5600697e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb578009990 tx=0x7fb578008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:45.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.144+0000 7fb57cff9700 1 -- 172.21.15.26:0/131391936 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb5700519a0 con 0x7fb58006a820 2023-09-28T00:15:45.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.332+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb580064050 con 0x7fb560067330 2023-09-28T00:15:45.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.340+0000 7fb57cff9700 1 -- 172.21.15.26:0/131391936 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284647 (secure 0 0 0) 0x7fb580064050 con 0x7fb560067330 2023-09-28T00:15:45.344 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb560067330 msgr2=0x7fb5600697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb560067330 0x7fb5600697e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb578009990 tx=0x7fb578008040 comp rx=0 tx=0).stop 2023-09-28T00:15:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb58006a820 msgr2=0x7fb580152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb58006a820 0x7fb580152f50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb57000cb10 tx=0x7fb5700017b0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 shutdown_connections 2023-09-28T00:15:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb560067330 0x7fb5600697e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb580157400 0x7fb5800b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb580068ed0 0x7fb5800ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 --2- 172.21.15.26:0/131391936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb58006a820 0x7fb580152f50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 >> 172.21.15.26:0/131391936 conn(0x7fb5800c9fc0 msgr2=0x7fb580069d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 shutdown_connections 2023-09-28T00:15:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.343+0000 7fb586b15700 1 -- 172.21.15.26:0/131391936 wait complete. 2023-09-28T00:15:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:15:45.356 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-09-28T00:15:43.671400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66344,"kb_used_data":3176,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908376,"statfs":{"total":773094113280,"available":773026177024,"internally_reserved":0,"allocated":3252224,"data_stored":1930452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003479"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393167+0000","last_change":"2023-09-28T00:15:29.392083+0000","last_active":"2023-09-28T00:15:29.393167+0000","last_peered":"2023-09-28T00:15:29.393167+0000","last_clean":"2023-09-28T00:15:29.393167+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:15:29.393167+0000","last_undegraded":"2023-09-28T00:15:29.393167+0000","last_fullsized":"2023-09-28T00:15:29.393167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:53.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391806+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:15:29.391806+0000","last_peered":"2023-09-28T00:15:29.391806+0000","last_clean":"2023-09-28T00:15:29.391806+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:15:29.391806+0000","last_undegraded":"2023-09-28T00:15:29.391806+0000","last_fullsized":"2023-09-28T00:15:29.391806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404174+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:15:29.404174+0000","last_peered":"2023-09-28T00:15:29.404174+0000","last_clean":"2023-09-28T00:15:29.404174+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:15:29.404174+0000","last_undegraded":"2023-09-28T00:15:29.404174+0000","last_fullsized":"2023-09-28T00:15:29.404174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:31:15.779086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394940+0000","last_change":"2023-09-28T00:15:29.387338+0000","last_active":"2023-09-28T00:15:29.394940+0000","last_peered":"2023-09-28T00:15:29.394940+0000","last_clean":"2023-09-28T00:15:29.394940+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:15:29.394940+0000","last_undegraded":"2023-09-28T00:15:29.394940+0000","last_fullsized":"2023-09-28T00:15:29.394940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:11.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402390+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:15:29.402390+0000","last_peered":"2023-09-28T00:15:29.402390+0000","last_clean":"2023-09-28T00:15:29.402390+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:15:29.402390+0000","last_undegraded":"2023-09-28T00:15:29.402390+0000","last_fullsized":"2023-09-28T00:15:29.402390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403262+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:15:29.403262+0000","last_peered":"2023-09-28T00:15:29.403262+0000","last_clean":"2023-09-28T00:15:29.403262+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:15:29.403262+0000","last_undegraded":"2023-09-28T00:15:29.403262+0000","last_fullsized":"2023-09-28T00:15:29.403262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:10.975572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390765+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:15:29.390765+0000","last_peered":"2023-09-28T00:15:29.390765+0000","last_clean":"2023-09-28T00:15:29.390765+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:15:29.390765+0000","last_undegraded":"2023-09-28T00:15:29.390765+0000","last_fullsized":"2023-09-28T00:15:29.390765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399845+0000","last_change":"2023-09-28T00:15:29.398742+0000","last_active":"2023-09-28T00:15:29.399845+0000","last_peered":"2023-09-28T00:15:29.399845+0000","last_clean":"2023-09-28T00:15:29.399845+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:15:29.399845+0000","last_undegraded":"2023-09-28T00:15:29.399845+0000","last_fullsized":"2023-09-28T00:15:29.399845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402654+0000","last_change":"2023-09-28T00:15:29.401666+0000","last_active":"2023-09-28T00:15:29.402654+0000","last_peered":"2023-09-28T00:15:29.402654+0000","last_clean":"2023-09-28T00:15:29.402654+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:15:29.402654+0000","last_undegraded":"2023-09-28T00:15:29.402654+0000","last_fullsized":"2023-09-28T00:15:29.402654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394457+0000","last_change":"2023-09-28T00:15:29.388253+0000","last_active":"2023-09-28T00:15:29.394457+0000","last_peered":"2023-09-28T00:15:29.394457+0000","last_clean":"2023-09-28T00:15:29.394457+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:15:29.394457+0000","last_undegraded":"2023-09-28T00:15:29.394457+0000","last_fullsized":"2023-09-28T00:15:29.394457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397977+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:15:29.397977+0000","last_peered":"2023-09-28T00:15:29.397977+0000","last_clean":"2023-09-28T00:15:29.397977+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:15:29.397977+0000","last_undegraded":"2023-09-28T00:15:29.397977+0000","last_fullsized":"2023-09-28T00:15:29.397977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400172+0000","last_change":"2023-09-28T00:15:29.399521+0000","last_active":"2023-09-28T00:15:29.400172+0000","last_peered":"2023-09-28T00:15:29.400172+0000","last_clean":"2023-09-28T00:15:29.400172+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:15:29.400172+0000","last_undegraded":"2023-09-28T00:15:29.400172+0000","last_fullsized":"2023-09-28T00:15:29.400172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:38.462117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393250+0000","last_change":"2023-09-28T00:15:29.392028+0000","last_active":"2023-09-28T00:15:29.393250+0000","last_peered":"2023-09-28T00:15:29.393250+0000","last_clean":"2023-09-28T00:15:29.393250+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:15:29.393250+0000","last_undegraded":"2023-09-28T00:15:29.393250+0000","last_fullsized":"2023-09-28T00:15:29.393250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397374+0000","last_change":"2023-09-28T00:15:29.394175+0000","last_active":"2023-09-28T00:15:29.397374+0000","last_peered":"2023-09-28T00:15:29.397374+0000","last_clean":"2023-09-28T00:15:29.397374+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:15:29.397374+0000","last_undegraded":"2023-09-28T00:15:29.397374+0000","last_fullsized":"2023-09-28T00:15:29.397374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394506+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:15:29.394506+0000","last_peered":"2023-09-28T00:15:29.394506+0000","last_clean":"2023-09-28T00:15:29.394506+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:15:29.394506+0000","last_undegraded":"2023-09-28T00:15:29.394506+0000","last_fullsized":"2023-09-28T00:15:29.394506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398296+0000","last_change":"2023-09-28T00:15:29.397273+0000","last_active":"2023-09-28T00:15:29.398296+0000","last_peered":"2023-09-28T00:15:29.398296+0000","last_clean":"2023-09-28T00:15:29.398296+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:15:29.398296+0000","last_undegraded":"2023-09-28T00:15:29.398296+0000","last_fullsized":"2023-09-28T00:15:29.398296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402636+0000","last_change":"2023-09-28T00:15:29.401695+0000","last_active":"2023-09-28T00:15:29.402636+0000","last_peered":"2023-09-28T00:15:29.402636+0000","last_clean":"2023-09-28T00:15:29.402636+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:15:29.402636+0000","last_undegraded":"2023-09-28T00:15:29.402636+0000","last_fullsized":"2023-09-28T00:15:29.402636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400097+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:15:29.400097+0000","last_peered":"2023-09-28T00:15:29.400097+0000","last_clean":"2023-09-28T00:15:29.400097+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:15:29.400097+0000","last_undegraded":"2023-09-28T00:15:29.400097+0000","last_fullsized":"2023-09-28T00:15:29.400097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391545+0000","last_change":"2023-09-28T00:15:29.386237+0000","last_active":"2023-09-28T00:15:29.391545+0000","last_peered":"2023-09-28T00:15:29.391545+0000","last_clean":"2023-09-28T00:15:29.391545+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:15:29.391545+0000","last_undegraded":"2023-09-28T00:15:29.391545+0000","last_fullsized":"2023-09-28T00:15:29.391545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403381+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:15:29.403381+0000","last_peered":"2023-09-28T00:15:29.403381+0000","last_clean":"2023-09-28T00:15:29.403381+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:15:29.403381+0000","last_undegraded":"2023-09-28T00:15:29.403381+0000","last_fullsized":"2023-09-28T00:15:29.403381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:49:33.646923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394054+0000","last_change":"2023-09-28T00:15:29.392231+0000","last_active":"2023-09-28T00:15:29.394054+0000","last_peered":"2023-09-28T00:15:29.394054+0000","last_clean":"2023-09-28T00:15:29.394054+0000","last_became_active":"2023-09-28T00:15:29.391855+0000","last_became_peered":"2023-09-28T00:15:29.391855+0000","last_unstale":"2023-09-28T00:15:29.394054+0000","last_undegraded":"2023-09-28T00:15:29.394054+0000","last_fullsized":"2023-09-28T00:15:29.394054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.401694+0000","last_change":"2023-09-28T00:15:29.394242+0000","last_active":"2023-09-28T00:15:29.401694+0000","last_peered":"2023-09-28T00:15:29.401694+0000","last_clean":"2023-09-28T00:15:29.401694+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:15:29.401694+0000","last_undegraded":"2023-09-28T00:15:29.401694+0000","last_fullsized":"2023-09-28T00:15:29.401694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391666+0000","last_change":"2023-09-28T00:15:29.389082+0000","last_active":"2023-09-28T00:15:29.391666+0000","last_peered":"2023-09-28T00:15:29.391666+0000","last_clean":"2023-09-28T00:15:29.391666+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:15:29.391666+0000","last_undegraded":"2023-09-28T00:15:29.391666+0000","last_fullsized":"2023-09-28T00:15:29.391666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394025+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:15:29.394025+0000","last_peered":"2023-09-28T00:15:29.394025+0000","last_clean":"2023-09-28T00:15:29.394025+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:15:29.394025+0000","last_undegraded":"2023-09-28T00:15:29.394025+0000","last_fullsized":"2023-09-28T00:15:29.394025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398162+0000","last_change":"2023-09-28T00:15:29.392586+0000","last_active":"2023-09-28T00:15:29.398162+0000","last_peered":"2023-09-28T00:15:29.398162+0000","last_clean":"2023-09-28T00:15:29.398162+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:15:29.398162+0000","last_undegraded":"2023-09-28T00:15:29.398162+0000","last_fullsized":"2023-09-28T00:15:29.398162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:16:11.243076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386766+0000","last_change":"2023-09-28T00:15:29.384837+0000","last_active":"2023-09-28T00:15:29.386766+0000","last_peered":"2023-09-28T00:15:29.386766+0000","last_clean":"2023-09-28T00:15:29.386766+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:15:29.386766+0000","last_undegraded":"2023-09-28T00:15:29.386766+0000","last_fullsized":"2023-09-28T00:15:29.386766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:49:32.973094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398577+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:15:29.398577+0000","last_peered":"2023-09-28T00:15:29.398577+0000","last_clean":"2023-09-28T00:15:29.398577+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:15:29.398577+0000","last_undegraded":"2023-09-28T00:15:29.398577+0000","last_fullsized":"2023-09-28T00:15:29.398577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399602+0000","last_change":"2023-09-28T00:15:28.982899+0000","last_active":"2023-09-28T00:15:29.399602+0000","last_peered":"2023-09-28T00:15:29.399602+0000","last_clean":"2023-09-28T00:15:29.399602+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:15:29.399602+0000","last_undegraded":"2023-09-28T00:15:29.399602+0000","last_fullsized":"2023-09-28T00:15:29.399602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390553+0000","last_change":"2023-09-28T00:15:29.383398+0000","last_active":"2023-09-28T00:15:29.390553+0000","last_peered":"2023-09-28T00:15:29.390553+0000","last_clean":"2023-09-28T00:15:29.390553+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:15:29.390553+0000","last_undegraded":"2023-09-28T00:15:29.390553+0000","last_fullsized":"2023-09-28T00:15:29.390553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380346+0000","last_change":"2023-09-28T00:15:28.984308+0000","last_active":"2023-09-28T00:15:29.380346+0000","last_peered":"2023-09-28T00:15:29.380346+0000","last_clean":"2023-09-28T00:15:29.380346+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:15:29.380346+0000","last_undegraded":"2023-09-28T00:15:29.380346+0000","last_fullsized":"2023-09-28T00:15:29.380346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402446+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:15:29.402446+0000","last_peered":"2023-09-28T00:15:29.402446+0000","last_clean":"2023-09-28T00:15:29.402446+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:15:29.402446+0000","last_undegraded":"2023-09-28T00:15:29.402446+0000","last_fullsized":"2023-09-28T00:15:29.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375855+0000","last_change":"2023-09-28T00:15:28.986600+0000","last_active":"2023-09-28T00:15:29.375855+0000","last_peered":"2023-09-28T00:15:29.375855+0000","last_clean":"2023-09-28T00:15:29.375855+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:15:29.375855+0000","last_undegraded":"2023-09-28T00:15:29.375855+0000","last_fullsized":"2023-09-28T00:15:29.375855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397007+0000","last_change":"2023-09-28T00:15:29.391209+0000","last_active":"2023-09-28T00:15:29.397007+0000","last_peered":"2023-09-28T00:15:29.397007+0000","last_clean":"2023-09-28T00:15:29.397007+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:15:29.397007+0000","last_undegraded":"2023-09-28T00:15:29.397007+0000","last_fullsized":"2023-09-28T00:15:29.397007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394579+0000","last_change":"2023-09-28T00:15:28.990492+0000","last_active":"2023-09-28T00:15:29.394579+0000","last_peered":"2023-09-28T00:15:29.394579+0000","last_clean":"2023-09-28T00:15:29.394579+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:15:29.394579+0000","last_undegraded":"2023-09-28T00:15:29.394579+0000","last_fullsized":"2023-09-28T00:15:29.394579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.387663+0000","last_change":"2023-09-28T00:15:29.381022+0000","last_active":"2023-09-28T00:15:29.387663+0000","last_peered":"2023-09-28T00:15:29.387663+0000","last_clean":"2023-09-28T00:15:29.387663+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:15:29.387663+0000","last_undegraded":"2023-09-28T00:15:29.387663+0000","last_fullsized":"2023-09-28T00:15:29.387663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378888+0000","last_change":"2023-09-28T00:15:28.989043+0000","last_active":"2023-09-28T00:15:29.378888+0000","last_peered":"2023-09-28T00:15:29.378888+0000","last_clean":"2023-09-28T00:15:29.378888+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:15:29.378888+0000","last_undegraded":"2023-09-28T00:15:29.378888+0000","last_fullsized":"2023-09-28T00:15:29.378888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391650+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:15:29.391650+0000","last_peered":"2023-09-28T00:15:29.391650+0000","last_clean":"2023-09-28T00:15:29.391650+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:15:29.391650+0000","last_undegraded":"2023-09-28T00:15:29.391650+0000","last_fullsized":"2023-09-28T00:15:29.391650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399129+0000","last_change":"2023-09-28T00:15:28.981865+0000","last_active":"2023-09-28T00:15:29.399129+0000","last_peered":"2023-09-28T00:15:29.399129+0000","last_clean":"2023-09-28T00:15:29.399129+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:15:29.399129+0000","last_undegraded":"2023-09-28T00:15:29.399129+0000","last_fullsized":"2023-09-28T00:15:29.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397590+0000","last_change":"2023-09-28T00:15:29.389604+0000","last_active":"2023-09-28T00:15:29.397590+0000","last_peered":"2023-09-28T00:15:29.397590+0000","last_clean":"2023-09-28T00:15:29.397590+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:15:29.397590+0000","last_undegraded":"2023-09-28T00:15:29.397590+0000","last_fullsized":"2023-09-28T00:15:29.397590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.405038+0000","last_change":"2023-09-28T00:15:28.979093+0000","last_active":"2023-09-28T00:15:29.405038+0000","last_peered":"2023-09-28T00:15:29.405038+0000","last_clean":"2023-09-28T00:15:29.405038+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:15:29.405038+0000","last_undegraded":"2023-09-28T00:15:29.405038+0000","last_fullsized":"2023-09-28T00:15:29.405038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404103+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:15:29.404103+0000","last_peered":"2023-09-28T00:15:29.404103+0000","last_clean":"2023-09-28T00:15:29.404103+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:15:29.404103+0000","last_undegraded":"2023-09-28T00:15:29.404103+0000","last_fullsized":"2023-09-28T00:15:29.404103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:59:40.497846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403068+0000","last_change":"2023-09-28T00:15:28.985348+0000","last_active":"2023-09-28T00:15:29.403068+0000","last_peered":"2023-09-28T00:15:29.403068+0000","last_clean":"2023-09-28T00:15:29.403068+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:15:29.403068+0000","last_undegraded":"2023-09-28T00:15:29.403068+0000","last_fullsized":"2023-09-28T00:15:29.403068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390525+0000","last_change":"2023-09-28T00:15:29.383322+0000","last_active":"2023-09-28T00:15:29.390525+0000","last_peered":"2023-09-28T00:15:29.390525+0000","last_clean":"2023-09-28T00:15:29.390525+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:15:29.390525+0000","last_undegraded":"2023-09-28T00:15:29.390525+0000","last_fullsized":"2023-09-28T00:15:29.390525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390540+0000","last_change":"2023-09-28T00:15:28.987818+0000","last_active":"2023-09-28T00:15:29.390540+0000","last_peered":"2023-09-28T00:15:29.390540+0000","last_clean":"2023-09-28T00:15:29.390540+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:15:29.390540+0000","last_undegraded":"2023-09-28T00:15:29.390540+0000","last_fullsized":"2023-09-28T00:15:29.390540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397462+0000","last_change":"2023-09-28T00:15:29.395546+0000","last_active":"2023-09-28T00:15:29.397462+0000","last_peered":"2023-09-28T00:15:29.397462+0000","last_clean":"2023-09-28T00:15:29.397462+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:15:29.397462+0000","last_undegraded":"2023-09-28T00:15:29.397462+0000","last_fullsized":"2023-09-28T00:15:29.397462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380953+0000","last_change":"2023-09-28T00:15:28.985438+0000","last_active":"2023-09-28T00:15:29.380953+0000","last_peered":"2023-09-28T00:15:29.380953+0000","last_clean":"2023-09-28T00:15:29.380953+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:15:29.380953+0000","last_undegraded":"2023-09-28T00:15:29.380953+0000","last_fullsized":"2023-09-28T00:15:29.380953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402467+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:15:29.402467+0000","last_peered":"2023-09-28T00:15:29.402467+0000","last_clean":"2023-09-28T00:15:29.402467+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:15:29.402467+0000","last_undegraded":"2023-09-28T00:15:29.402467+0000","last_fullsized":"2023-09-28T00:15:29.402467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403755+0000","last_change":"2023-09-28T00:15:28.983275+0000","last_active":"2023-09-28T00:15:29.403755+0000","last_peered":"2023-09-28T00:15:29.403755+0000","last_clean":"2023-09-28T00:15:29.403755+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:15:29.403755+0000","last_undegraded":"2023-09-28T00:15:29.403755+0000","last_fullsized":"2023-09-28T00:15:29.403755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:10:17.162300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396946+0000","last_change":"2023-09-28T00:15:29.393952+0000","last_active":"2023-09-28T00:15:29.396946+0000","last_peered":"2023-09-28T00:15:29.396946+0000","last_clean":"2023-09-28T00:15:29.396946+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:15:29.396946+0000","last_undegraded":"2023-09-28T00:15:29.396946+0000","last_fullsized":"2023-09-28T00:15:29.396946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402648+0000","last_change":"2023-09-28T00:15:28.986391+0000","last_active":"2023-09-28T00:15:29.402648+0000","last_peered":"2023-09-28T00:15:29.402648+0000","last_clean":"2023-09-28T00:15:29.402648+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:15:29.402648+0000","last_undegraded":"2023-09-28T00:15:29.402648+0000","last_fullsized":"2023-09-28T00:15:29.402648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396755+0000","last_change":"2023-09-28T00:15:29.393474+0000","last_active":"2023-09-28T00:15:29.396755+0000","last_peered":"2023-09-28T00:15:29.396755+0000","last_clean":"2023-09-28T00:15:29.396755+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:15:29.396755+0000","last_undegraded":"2023-09-28T00:15:29.396755+0000","last_fullsized":"2023-09-28T00:15:29.396755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402943+0000","last_change":"2023-09-28T00:15:28.986082+0000","last_active":"2023-09-28T00:15:29.402943+0000","last_peered":"2023-09-28T00:15:29.402943+0000","last_clean":"2023-09-28T00:15:29.402943+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:15:29.402943+0000","last_undegraded":"2023-09-28T00:15:29.402943+0000","last_fullsized":"2023-09-28T00:15:29.402943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:16.392360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397610+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:15:29.397610+0000","last_peered":"2023-09-28T00:15:29.397610+0000","last_clean":"2023-09-28T00:15:29.397610+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:15:29.397610+0000","last_undegraded":"2023-09-28T00:15:29.397610+0000","last_fullsized":"2023-09-28T00:15:29.397610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:11:37.490848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399248+0000","last_change":"2023-09-28T00:15:28.982433+0000","last_active":"2023-09-28T00:15:29.399248+0000","last_peered":"2023-09-28T00:15:29.399248+0000","last_clean":"2023-09-28T00:15:29.399248+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:15:29.399248+0000","last_undegraded":"2023-09-28T00:15:29.399248+0000","last_fullsized":"2023-09-28T00:15:29.399248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:37:52.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395572+0000","last_change":"2023-09-28T00:15:29.388766+0000","last_active":"2023-09-28T00:15:29.395572+0000","last_peered":"2023-09-28T00:15:29.395572+0000","last_clean":"2023-09-28T00:15:29.395572+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:15:29.395572+0000","last_undegraded":"2023-09-28T00:15:29.395572+0000","last_fullsized":"2023-09-28T00:15:29.395572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.381202+0000","last_change":"2023-09-28T00:15:28.984089+0000","last_active":"2023-09-28T00:15:29.381202+0000","last_peered":"2023-09-28T00:15:29.381202+0000","last_clean":"2023-09-28T00:15:29.381202+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:15:29.381202+0000","last_undegraded":"2023-09-28T00:15:29.381202+0000","last_fullsized":"2023-09-28T00:15:29.381202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394391+0000","last_change":"2023-09-28T00:15:29.386850+0000","last_active":"2023-09-28T00:15:29.394391+0000","last_peered":"2023-09-28T00:15:29.394391+0000","last_clean":"2023-09-28T00:15:29.394391+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:15:29.394391+0000","last_undegraded":"2023-09-28T00:15:29.394391+0000","last_fullsized":"2023-09-28T00:15:29.394391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402306+0000","last_change":"2023-09-28T00:15:28.986069+0000","last_active":"2023-09-28T00:15:29.402306+0000","last_peered":"2023-09-28T00:15:29.402306+0000","last_clean":"2023-09-28T00:15:29.402306+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:15:29.402306+0000","last_undegraded":"2023-09-28T00:15:29.402306+0000","last_fullsized":"2023-09-28T00:15:29.402306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397756+0000","last_change":"2023-09-28T00:15:29.393182+0000","last_active":"2023-09-28T00:15:29.397756+0000","last_peered":"2023-09-28T00:15:29.397756+0000","last_clean":"2023-09-28T00:15:29.397756+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:15:29.397756+0000","last_undegraded":"2023-09-28T00:15:29.397756+0000","last_fullsized":"2023-09-28T00:15:29.397756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385144+0000","last_change":"2023-09-28T00:15:28.985291+0000","last_active":"2023-09-28T00:15:29.385144+0000","last_peered":"2023-09-28T00:15:29.385144+0000","last_clean":"2023-09-28T00:15:29.385144+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:15:29.385144+0000","last_undegraded":"2023-09-28T00:15:29.385144+0000","last_fullsized":"2023-09-28T00:15:29.385144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404083+0000","last_change":"2023-09-28T00:15:29.400083+0000","last_active":"2023-09-28T00:15:29.404083+0000","last_peered":"2023-09-28T00:15:29.404083+0000","last_clean":"2023-09-28T00:15:29.404083+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:15:29.404083+0000","last_undegraded":"2023-09-28T00:15:29.404083+0000","last_fullsized":"2023-09-28T00:15:29.404083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385946+0000","last_change":"2023-09-28T00:15:28.980715+0000","last_active":"2023-09-28T00:15:29.385946+0000","last_peered":"2023-09-28T00:15:29.385946+0000","last_clean":"2023-09-28T00:15:29.385946+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:15:29.385946+0000","last_undegraded":"2023-09-28T00:15:29.385946+0000","last_fullsized":"2023-09-28T00:15:29.385946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400065+0000","last_change":"2023-09-28T00:15:29.397875+0000","last_active":"2023-09-28T00:15:29.400065+0000","last_peered":"2023-09-28T00:15:29.400065+0000","last_clean":"2023-09-28T00:15:29.400065+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:15:29.400065+0000","last_undegraded":"2023-09-28T00:15:29.400065+0000","last_fullsized":"2023-09-28T00:15:29.400065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:35:06.112174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375411+0000","last_change":"2023-09-28T00:15:28.986410+0000","last_active":"2023-09-28T00:15:29.375411+0000","last_peered":"2023-09-28T00:15:29.375411+0000","last_clean":"2023-09-28T00:15:29.375411+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:15:29.375411+0000","last_undegraded":"2023-09-28T00:15:29.375411+0000","last_fullsized":"2023-09-28T00:15:29.375411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398187+0000","last_change":"2023-09-28T00:15:29.392748+0000","last_active":"2023-09-28T00:15:29.398187+0000","last_peered":"2023-09-28T00:15:29.398187+0000","last_clean":"2023-09-28T00:15:29.398187+0000","last_became_active":"2023-09-28T00:15:29.392336+0000","last_became_peered":"2023-09-28T00:15:29.392336+0000","last_unstale":"2023-09-28T00:15:29.398187+0000","last_undegraded":"2023-09-28T00:15:29.398187+0000","last_fullsized":"2023-09-28T00:15:29.398187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380356+0000","last_change":"2023-09-28T00:15:24.193273+0000","last_active":"2023-09-28T00:15:29.380356+0000","last_peered":"2023-09-28T00:15:29.380356+0000","last_clean":"2023-09-28T00:15:29.380356+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:15:29.380356+0000","last_undegraded":"2023-09-28T00:15:29.380356+0000","last_fullsized":"2023-09-28T00:15:29.380356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:55:44.401134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379326+0000","last_change":"2023-09-28T00:15:28.986194+0000","last_active":"2023-09-28T00:15:29.379326+0000","last_peered":"2023-09-28T00:15:29.379326+0000","last_clean":"2023-09-28T00:15:29.379326+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:15:29.379326+0000","last_undegraded":"2023-09-28T00:15:29.379326+0000","last_fullsized":"2023-09-28T00:15:29.379326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390889+0000","last_change":"2023-09-28T00:15:29.388604+0000","last_active":"2023-09-28T00:15:29.390889+0000","last_peered":"2023-09-28T00:15:29.390889+0000","last_clean":"2023-09-28T00:15:29.390889+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:15:29.390889+0000","last_undegraded":"2023-09-28T00:15:29.390889+0000","last_fullsized":"2023-09-28T00:15:29.390889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378226+0000","last_change":"2023-09-28T00:15:23.950475+0000","last_active":"2023-09-28T00:15:29.378226+0000","last_peered":"2023-09-28T00:15:29.378226+0000","last_clean":"2023-09-28T00:15:29.378226+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:15:29.378226+0000","last_undegraded":"2023-09-28T00:15:29.378226+0000","last_fullsized":"2023-09-28T00:15:29.378226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386282+0000","last_change":"2023-09-28T00:15:28.984604+0000","last_active":"2023-09-28T00:15:29.386282+0000","last_peered":"2023-09-28T00:15:29.386282+0000","last_clean":"2023-09-28T00:15:29.386282+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:15:29.386282+0000","last_undegraded":"2023-09-28T00:15:29.386282+0000","last_fullsized":"2023-09-28T00:15:29.386282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398171+0000","last_change":"2023-09-28T00:15:29.392616+0000","last_active":"2023-09-28T00:15:29.398171+0000","last_peered":"2023-09-28T00:15:29.398171+0000","last_clean":"2023-09-28T00:15:29.398171+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:15:29.398171+0000","last_undegraded":"2023-09-28T00:15:29.398171+0000","last_fullsized":"2023-09-28T00:15:29.398171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:20:56.060002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379003+0000","last_change":"2023-09-28T00:15:24.193731+0000","last_active":"2023-09-28T00:15:29.379003+0000","last_peered":"2023-09-28T00:15:29.379003+0000","last_clean":"2023-09-28T00:15:29.379003+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:15:29.379003+0000","last_undegraded":"2023-09-28T00:15:29.379003+0000","last_fullsized":"2023-09-28T00:15:29.379003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:10:07.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378537+0000","last_change":"2023-09-28T00:15:28.980294+0000","last_active":"2023-09-28T00:15:29.378537+0000","last_peered":"2023-09-28T00:15:29.378537+0000","last_clean":"2023-09-28T00:15:29.378537+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:15:29.378537+0000","last_undegraded":"2023-09-28T00:15:29.378537+0000","last_fullsized":"2023-09-28T00:15:29.378537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390883+0000","last_change":"2023-09-28T00:15:29.388008+0000","last_active":"2023-09-28T00:15:29.390883+0000","last_peered":"2023-09-28T00:15:29.390883+0000","last_clean":"2023-09-28T00:15:29.390883+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:15:29.390883+0000","last_undegraded":"2023-09-28T00:15:29.390883+0000","last_fullsized":"2023-09-28T00:15:29.390883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.377855+0000","last_change":"2023-09-28T00:15:23.950457+0000","last_active":"2023-09-28T00:15:29.377855+0000","last_peered":"2023-09-28T00:15:29.377855+0000","last_clean":"2023-09-28T00:15:29.377855+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:15:29.377855+0000","last_undegraded":"2023-09-28T00:15:29.377855+0000","last_fullsized":"2023-09-28T00:15:29.377855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380256+0000","last_change":"2023-09-28T00:15:16.995081+0000","last_active":"2023-09-28T00:15:29.380256+0000","last_peered":"2023-09-28T00:15:29.380256+0000","last_clean":"2023-09-28T00:15:29.380256+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:15:29.380256+0000","last_undegraded":"2023-09-28T00:15:29.380256+0000","last_fullsized":"2023-09-28T00:15:29.380256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_clean_scrub_stamp":"2023-09-28T00:15:15.867916+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:37:49.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375538+0000","last_change":"2023-09-28T00:15:28.985016+0000","last_active":"2023-09-28T00:15:29.375538+0000","last_peered":"2023-09-28T00:15:29.375538+0000","last_clean":"2023-09-28T00:15:29.375538+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:15:29.375538+0000","last_undegraded":"2023-09-28T00:15:29.375538+0000","last_fullsized":"2023-09-28T00:15:29.375538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403095+0000","last_change":"2023-09-28T00:15:29.401863+0000","last_active":"2023-09-28T00:15:29.403095+0000","last_peered":"2023-09-28T00:15:29.403095+0000","last_clean":"2023-09-28T00:15:29.403095+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:15:29.403095+0000","last_undegraded":"2023-09-28T00:15:29.403095+0000","last_fullsized":"2023-09-28T00:15:29.403095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:17.400054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380675+0000","last_change":"2023-09-28T00:15:23.946737+0000","last_active":"2023-09-28T00:15:29.380675+0000","last_peered":"2023-09-28T00:15:29.380675+0000","last_clean":"2023-09-28T00:15:29.380675+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:15:29.380675+0000","last_undegraded":"2023-09-28T00:15:29.380675+0000","last_fullsized":"2023-09-28T00:15:29.380675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386570+0000","last_change":"2023-09-28T00:15:28.986464+0000","last_active":"2023-09-28T00:15:29.386570+0000","last_peered":"2023-09-28T00:15:29.386570+0000","last_clean":"2023-09-28T00:15:29.386570+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:15:29.386570+0000","last_undegraded":"2023-09-28T00:15:29.386570+0000","last_fullsized":"2023-09-28T00:15:29.386570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398876+0000","last_change":"2023-09-28T00:15:29.390313+0000","last_active":"2023-09-28T00:15:29.398876+0000","last_peered":"2023-09-28T00:15:29.398876+0000","last_clean":"2023-09-28T00:15:29.398876+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:15:29.398876+0000","last_undegraded":"2023-09-28T00:15:29.398876+0000","last_fullsized":"2023-09-28T00:15:29.398876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379277+0000","last_change":"2023-09-28T00:15:24.193260+0000","last_active":"2023-09-28T00:15:29.379277+0000","last_peered":"2023-09-28T00:15:29.379277+0000","last_clean":"2023-09-28T00:15:29.379277+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:15:29.379277+0000","last_undegraded":"2023-09-28T00:15:29.379277+0000","last_fullsized":"2023-09-28T00:15:29.379277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380464+0000","last_change":"2023-09-28T00:15:28.979725+0000","last_active":"2023-09-28T00:15:29.380464+0000","last_peered":"2023-09-28T00:15:29.380464+0000","last_clean":"2023-09-28T00:15:29.380464+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:15:29.380464+0000","last_undegraded":"2023-09-28T00:15:29.380464+0000","last_fullsized":"2023-09-28T00:15:29.380464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402412+0000","last_change":"2023-09-28T00:15:29.398984+0000","last_active":"2023-09-28T00:15:29.402412+0000","last_peered":"2023-09-28T00:15:29.402412+0000","last_clean":"2023-09-28T00:15:29.402412+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:15:29.402412+0000","last_undegraded":"2023-09-28T00:15:29.402412+0000","last_fullsized":"2023-09-28T00:15:29.402412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395338+0000","last_change":"2023-09-28T00:15:28.989236+0000","last_active":"2023-09-28T00:15:29.395338+0000","last_peered":"2023-09-28T00:15:29.395338+0000","last_clean":"2023-09-28T00:15:29.395338+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:15:29.395338+0000","last_undegraded":"2023-09-28T00:15:29.395338+0000","last_fullsized":"2023-09-28T00:15:29.395338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380630+0000","last_change":"2023-09-28T00:15:23.949425+0000","last_active":"2023-09-28T00:15:29.380630+0000","last_peered":"2023-09-28T00:15:29.380630+0000","last_clean":"2023-09-28T00:15:29.380630+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:15:29.380630+0000","last_undegraded":"2023-09-28T00:15:29.380630+0000","last_fullsized":"2023-09-28T00:15:29.380630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:59:04.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391469+0000","last_change":"2023-09-28T00:15:29.386508+0000","last_active":"2023-09-28T00:15:29.391469+0000","last_peered":"2023-09-28T00:15:29.391469+0000","last_clean":"2023-09-28T00:15:29.391469+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:15:29.391469+0000","last_undegraded":"2023-09-28T00:15:29.391469+0000","last_fullsized":"2023-09-28T00:15:29.391469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385234+0000","last_change":"2023-09-28T00:15:23.949692+0000","last_active":"2023-09-28T00:15:29.385234+0000","last_peered":"2023-09-28T00:15:29.385234+0000","last_clean":"2023-09-28T00:15:29.385234+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:15:29.385234+0000","last_undegraded":"2023-09-28T00:15:29.385234+0000","last_fullsized":"2023-09-28T00:15:29.385234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:48:11.275095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778335+0000","last_change":"2023-09-28T00:15:28.988077+0000","last_active":"2023-09-28T00:15:30.778335+0000","last_peered":"2023-09-28T00:15:30.778335+0000","last_clean":"2023-09-28T00:15:30.778335+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:15:30.778335+0000","last_undegraded":"2023-09-28T00:15:30.778335+0000","last_fullsized":"2023-09-28T00:15:30.778335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399373+0000","last_change":"2023-09-28T00:15:29.398170+0000","last_active":"2023-09-28T00:15:29.399373+0000","last_peered":"2023-09-28T00:15:29.399373+0000","last_clean":"2023-09-28T00:15:29.399373+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:15:29.399373+0000","last_undegraded":"2023-09-28T00:15:29.399373+0000","last_fullsized":"2023-09-28T00:15:29.399373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:30:23.382889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402252+0000","last_change":"2023-09-28T00:15:28.987224+0000","last_active":"2023-09-28T00:15:29.402252+0000","last_peered":"2023-09-28T00:15:29.402252+0000","last_clean":"2023-09-28T00:15:29.402252+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:15:29.402252+0000","last_undegraded":"2023-09-28T00:15:29.402252+0000","last_fullsized":"2023-09-28T00:15:29.402252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391371+0000","last_change":"2023-09-28T00:15:29.383759+0000","last_active":"2023-09-28T00:15:29.391371+0000","last_peered":"2023-09-28T00:15:29.391371+0000","last_clean":"2023-09-28T00:15:29.391371+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:15:29.391371+0000","last_undegraded":"2023-09-28T00:15:29.391371+0000","last_fullsized":"2023-09-28T00:15:29.391371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:06.286162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402275+0000","last_change":"2023-09-28T00:15:28.987633+0000","last_active":"2023-09-28T00:15:29.402275+0000","last_peered":"2023-09-28T00:15:29.402275+0000","last_clean":"2023-09-28T00:15:29.402275+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:15:29.402275+0000","last_undegraded":"2023-09-28T00:15:29.402275+0000","last_fullsized":"2023-09-28T00:15:29.402275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398131+0000","last_change":"2023-09-28T00:15:29.392897+0000","last_active":"2023-09-28T00:15:29.398131+0000","last_peered":"2023-09-28T00:15:29.398131+0000","last_clean":"2023-09-28T00:15:29.398131+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:15:29.398131+0000","last_undegraded":"2023-09-28T00:15:29.398131+0000","last_fullsized":"2023-09-28T00:15:29.398131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403684+0000","last_change":"2023-09-28T00:15:28.987962+0000","last_active":"2023-09-28T00:15:29.403684+0000","last_peered":"2023-09-28T00:15:29.403684+0000","last_clean":"2023-09-28T00:15:29.403684+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:15:29.403684+0000","last_undegraded":"2023-09-28T00:15:29.403684+0000","last_fullsized":"2023-09-28T00:15:29.403684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399076+0000","last_change":"2023-09-28T00:15:29.394598+0000","last_active":"2023-09-28T00:15:29.399076+0000","last_peered":"2023-09-28T00:15:29.399076+0000","last_clean":"2023-09-28T00:15:29.399076+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:15:29.399076+0000","last_undegraded":"2023-09-28T00:15:29.399076+0000","last_fullsized":"2023-09-28T00:15:29.399076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396285+0000","last_change":"2023-09-28T00:15:28.983686+0000","last_active":"2023-09-28T00:15:29.396285+0000","last_peered":"2023-09-28T00:15:29.396285+0000","last_clean":"2023-09-28T00:15:29.396285+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:15:29.396285+0000","last_undegraded":"2023-09-28T00:15:29.396285+0000","last_fullsized":"2023-09-28T00:15:29.396285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391633+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:15:29.391633+0000","last_peered":"2023-09-28T00:15:29.391633+0000","last_clean":"2023-09-28T00:15:29.391633+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:15:29.391633+0000","last_undegraded":"2023-09-28T00:15:29.391633+0000","last_fullsized":"2023-09-28T00:15:29.391633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402519+0000","last_change":"2023-09-28T00:15:28.985280+0000","last_active":"2023-09-28T00:15:29.402519+0000","last_peered":"2023-09-28T00:15:29.402519+0000","last_clean":"2023-09-28T00:15:29.402519+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:15:29.402519+0000","last_undegraded":"2023-09-28T00:15:29.402519+0000","last_fullsized":"2023-09-28T00:15:29.402519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400030+0000","last_change":"2023-09-28T00:15:29.398360+0000","last_active":"2023-09-28T00:15:29.400030+0000","last_peered":"2023-09-28T00:15:29.400030+0000","last_clean":"2023-09-28T00:15:29.400030+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:15:29.400030+0000","last_undegraded":"2023-09-28T00:15:29.400030+0000","last_fullsized":"2023-09-28T00:15:29.400030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:58:13.878285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400854+0000","last_change":"2023-09-28T00:15:29.395080+0000","last_active":"2023-09-28T00:15:29.400854+0000","last_peered":"2023-09-28T00:15:29.400854+0000","last_clean":"2023-09-28T00:15:29.400854+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:15:29.400854+0000","last_undegraded":"2023-09-28T00:15:29.400854+0000","last_fullsized":"2023-09-28T00:15:29.400854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:39.792299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391615+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:15:29.391615+0000","last_peered":"2023-09-28T00:15:29.391615+0000","last_clean":"2023-09-28T00:15:29.391615+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:15:29.391615+0000","last_undegraded":"2023-09-28T00:15:29.391615+0000","last_fullsized":"2023-09-28T00:15:29.391615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403283+0000","last_change":"2023-09-28T00:15:29.399203+0000","last_active":"2023-09-28T00:15:29.403283+0000","last_peered":"2023-09-28T00:15:29.403283+0000","last_clean":"2023-09-28T00:15:29.403283+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:15:29.403283+0000","last_undegraded":"2023-09-28T00:15:29.403283+0000","last_fullsized":"2023-09-28T00:15:29.403283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:47:48.079491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391392+0000","last_change":"2023-09-28T00:15:29.388644+0000","last_active":"2023-09-28T00:15:29.391392+0000","last_peered":"2023-09-28T00:15:29.391392+0000","last_clean":"2023-09-28T00:15:29.391392+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:15:29.391392+0000","last_undegraded":"2023-09-28T00:15:29.391392+0000","last_fullsized":"2023-09-28T00:15:29.391392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390790+0000","last_change":"2023-09-28T00:15:29.388432+0000","last_active":"2023-09-28T00:15:29.390790+0000","last_peered":"2023-09-28T00:15:29.390790+0000","last_clean":"2023-09-28T00:15:29.390790+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:15:29.390790+0000","last_undegraded":"2023-09-28T00:15:29.390790+0000","last_fullsized":"2023-09-28T00:15:29.390790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8004,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363836,"statfs":{"total":96636764160,"available":96628568064,"internally_reserved":0,"allocated":258048,"data_stored":93762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9092,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362748,"statfs":{"total":96636764160,"available":96627453952,"internally_reserved":0,"allocated":847872,"data_stored":684060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9116,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362724,"statfs":{"total":96636764160,"available":96627429376,"internally_reserved":0,"allocated":872448,"data_stored":685258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7932,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363908,"statfs":{"total":96636764160,"available":96628641792,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":93228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":270336,"data_stored":94730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:15:45.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:15:45.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.516+0000 7fd33643a700 1 Processor -- start 2023-09-28T00:15:45.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.516+0000 7fd33643a700 1 -- start start 2023-09-28T00:15:45.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd33643a700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd33015d930 0x7fd3300d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd33643a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd3301591b0 0x7fd330159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd33643a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3300b2ad0 con 0x7fd33015d560 2023-09-28T00:15:45.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd33643a700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3300b4160 con 0x7fd33015d930 2023-09-28T00:15:45.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd33643a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3300b2230 con 0x7fd3301591b0 2023-09-28T00:15:45.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd32f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd33015d930 0x7fd3300d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd32f7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd33015d930 0x7fd3300d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40092/0 (socket says 172.21.15.26:40092) 2023-09-28T00:15:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd32ffff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd33015d560 0x7fd3300b1a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49246/0 (socket says 172.21.15.26:49246) 2023-09-28T00:15:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd32f7fe700 1 -- 172.21.15.26:0/3399088348 learned_addr learned my addr 172.21.15.26:0/3399088348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd3349d7700 1 --2- 172.21.15.26:0/3399088348 >> v2:172.21.15.190:3300/0 conn(0x7fd3301591b0 0x7fd330159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd32f7fe700 1 -- 172.21.15.26:0/3399088348 >> v2:172.21.15.190:3300/0 conn(0x7fd3301591b0 msgr2=0x7fd330159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/3399088348 >> v2:172.21.15.190:3300/0 conn(0x7fd3301591b0 0x7fd330159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd32f7fe700 1 -- 172.21.15.26:0/3399088348 >> v1:172.21.15.26:6789/0 conn(0x7fd33015d560 legacy=0x7fd3300b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd32f7fe700 1 -- 172.21.15.26:0/3399088348 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3300b2510 con 0x7fd33015d930 2023-09-28T00:15:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.517+0000 7fd32effd700 1 -- 172.21.15.26:0/3399088348 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151836972 0 0) 0x7fd3300b2ad0 con 0x7fd33015d560 2023-09-28T00:15:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/3399088348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d930 0x7fd3300d0030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd3300b3af0 tx=0x7fd324009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d537aa292173a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd32effd700 1 -- 172.21.15.26:0/3399088348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400b860 con 0x7fd33015d930 2023-09-28T00:15:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd32effd700 1 -- 172.21.15.26:0/3399088348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32400b9c0 con 0x7fd33015d930 2023-09-28T00:15:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd32effd700 1 -- 172.21.15.26:0/3399088348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400bd60 con 0x7fd33015d930 2023-09-28T00:15:45.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd33643a700 1 -- 172.21.15.26:0/3399088348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d930 msgr2=0x7fd3300d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd33643a700 1 --2- 172.21.15.26:0/3399088348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d930 0x7fd3300d0030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd3300b3af0 tx=0x7fd324009250 comp rx=0 tx=0).stop 2023-09-28T00:15:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd33643a700 1 -- 172.21.15.26:0/3399088348 shutdown_connections 2023-09-28T00:15:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd33643a700 1 --2- 172.21.15.26:0/3399088348 >> v2:172.21.15.190:3300/0 conn(0x7fd3301591b0 0x7fd330159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd33643a700 1 --2- 172.21.15.26:0/3399088348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d930 0x7fd3300d0030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd33643a700 1 -- 172.21.15.26:0/3399088348 >> 172.21.15.26:0/3399088348 conn(0x7fd3300d1180 msgr2=0x7fd330069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd33643a700 1 -- 172.21.15.26:0/3399088348 shutdown_connections 2023-09-28T00:15:45.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.518+0000 7fd33643a700 1 -- 172.21.15.26:0/3399088348 wait complete. 2023-09-28T00:15:45.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.519+0000 7fd33643a700 1 Processor -- start 2023-09-28T00:15:45.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.520+0000 7fd33643a700 1 -- start start 2023-09-28T00:15:45.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.520+0000 7fd33643a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3301591b0 0x7fd33014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.520+0000 7fd33643a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d560 0x7fd330151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.520+0000 7fd33643a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd33015d930 0x7fd33014d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.526 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.520+0000 7fd33643a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301544f0 con 0x7fd33015d560 2023-09-28T00:15:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.520+0000 7fd33643a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33016e510 con 0x7fd3301591b0 2023-09-28T00:15:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.520+0000 7fd33643a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33014f500 con 0x7fd33015d930 2023-09-28T00:15:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d560 0x7fd330151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d560 0x7fd330151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40100/0 (socket says 172.21.15.26:40100) 2023-09-28T00:15:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32f7fe700 1 -- 172.21.15.26:0/1678148344 learned_addr learned my addr 172.21.15.26:0/1678148344 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32ffff700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3301591b0 0x7fd33014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd3349d7700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd33015d930 0x7fd33014d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32f7fe700 1 -- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd33015d930 msgr2=0x7fd33014d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd33015d930 0x7fd33014d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32f7fe700 1 -- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3301591b0 msgr2=0x7fd33014f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3301591b0 0x7fd33014f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32f7fe700 1 -- 172.21.15.26:0/1678148344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3240094f0 con 0x7fd33015d560 2023-09-28T00:15:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd32f7fe700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d560 0x7fd330151250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd324006f50 tx=0x7fd324017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd317fff700 1 -- 172.21.15.26:0/1678148344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32401a450 con 0x7fd33015d560 2023-09-28T00:15:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd317fff700 1 -- 172.21.15.26:0/1678148344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32401a5d0 con 0x7fd33015d560 2023-09-28T00:15:45.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd330151790 con 0x7fd33015d560 2023-09-28T00:15:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd317fff700 1 -- 172.21.15.26:0/1678148344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32401a990 con 0x7fd33015d560 2023-09-28T00:15:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.521+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33014eeb0 con 0x7fd33015d560 2023-09-28T00:15:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.522+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33014ed20 con 0x7fd33015d560 2023-09-28T00:15:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.523+0000 7fd317fff700 1 -- 172.21.15.26:0/1678148344 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd32401ad00 con 0x7fd33015d560 2023-09-28T00:15:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.523+0000 7fd317fff700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd31c067330 0x7fd31c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.523+0000 7fd317fff700 1 -- 172.21.15.26:0/1678148344 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd324086640 con 0x7fd33015d560 2023-09-28T00:15:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.523+0000 7fd32ffff700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd31c067330 0x7fd31c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.524+0000 7fd32ffff700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd31c067330 0x7fd31c0697e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd320007fd0 tx=0x7fd320007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:45.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.527+0000 7fd317fff700 1 -- 172.21.15.26:0/1678148344 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd3240535c0 con 0x7fd33015d560 2023-09-28T00:15:45.717 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.716+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd33014f670 con 0x7fd31c067330 2023-09-28T00:15:45.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.724+0000 7fd317fff700 1 -- 172.21.15.26:0/1678148344 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284675 (secure 0 0 0) 0x7fd33014f670 con 0x7fd31c067330 2023-09-28T00:15:45.728 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:45.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd31c067330 msgr2=0x7fd31c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd31c067330 0x7fd31c0697e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd320007fd0 tx=0x7fd320007d50 comp rx=0 tx=0).stop 2023-09-28T00:15:45.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d560 msgr2=0x7fd330151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d560 0x7fd330151250 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd324006f50 tx=0x7fd324017000 comp rx=0 tx=0).stop 2023-09-28T00:15:45.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 shutdown_connections 2023-09-28T00:15:45.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd31c067330 0x7fd31c0697e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd33015d930 0x7fd33014d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd3301591b0 0x7fd33014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 --2- 172.21.15.26:0/1678148344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd33015d560 0x7fd330151250 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 >> 172.21.15.26:0/1678148344 conn(0x7fd3300d1180 msgr2=0x7fd3300698d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 shutdown_connections 2023-09-28T00:15:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.727+0000 7fd33643a700 1 -- 172.21.15.26:0/1678148344 wait complete. 2023-09-28T00:15:45.732 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:15:45.740 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-09-28T00:15:45.671828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66344,"kb_used_data":3176,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908376,"statfs":{"total":773094113280,"available":773026177024,"internally_reserved":0,"allocated":3252224,"data_stored":1930452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003393"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393167+0000","last_change":"2023-09-28T00:15:29.392083+0000","last_active":"2023-09-28T00:15:29.393167+0000","last_peered":"2023-09-28T00:15:29.393167+0000","last_clean":"2023-09-28T00:15:29.393167+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:15:29.393167+0000","last_undegraded":"2023-09-28T00:15:29.393167+0000","last_fullsized":"2023-09-28T00:15:29.393167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:53.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391806+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:15:29.391806+0000","last_peered":"2023-09-28T00:15:29.391806+0000","last_clean":"2023-09-28T00:15:29.391806+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:15:29.391806+0000","last_undegraded":"2023-09-28T00:15:29.391806+0000","last_fullsized":"2023-09-28T00:15:29.391806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404174+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:15:29.404174+0000","last_peered":"2023-09-28T00:15:29.404174+0000","last_clean":"2023-09-28T00:15:29.404174+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:15:29.404174+0000","last_undegraded":"2023-09-28T00:15:29.404174+0000","last_fullsized":"2023-09-28T00:15:29.404174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:31:15.779086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394940+0000","last_change":"2023-09-28T00:15:29.387338+0000","last_active":"2023-09-28T00:15:29.394940+0000","last_peered":"2023-09-28T00:15:29.394940+0000","last_clean":"2023-09-28T00:15:29.394940+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:15:29.394940+0000","last_undegraded":"2023-09-28T00:15:29.394940+0000","last_fullsized":"2023-09-28T00:15:29.394940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:11.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402390+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:15:29.402390+0000","last_peered":"2023-09-28T00:15:29.402390+0000","last_clean":"2023-09-28T00:15:29.402390+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:15:29.402390+0000","last_undegraded":"2023-09-28T00:15:29.402390+0000","last_fullsized":"2023-09-28T00:15:29.402390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403262+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:15:29.403262+0000","last_peered":"2023-09-28T00:15:29.403262+0000","last_clean":"2023-09-28T00:15:29.403262+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:15:29.403262+0000","last_undegraded":"2023-09-28T00:15:29.403262+0000","last_fullsized":"2023-09-28T00:15:29.403262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:10.975572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390765+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:15:29.390765+0000","last_peered":"2023-09-28T00:15:29.390765+0000","last_clean":"2023-09-28T00:15:29.390765+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:15:29.390765+0000","last_undegraded":"2023-09-28T00:15:29.390765+0000","last_fullsized":"2023-09-28T00:15:29.390765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399845+0000","last_change":"2023-09-28T00:15:29.398742+0000","last_active":"2023-09-28T00:15:29.399845+0000","last_peered":"2023-09-28T00:15:29.399845+0000","last_clean":"2023-09-28T00:15:29.399845+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:15:29.399845+0000","last_undegraded":"2023-09-28T00:15:29.399845+0000","last_fullsized":"2023-09-28T00:15:29.399845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402654+0000","last_change":"2023-09-28T00:15:29.401666+0000","last_active":"2023-09-28T00:15:29.402654+0000","last_peered":"2023-09-28T00:15:29.402654+0000","last_clean":"2023-09-28T00:15:29.402654+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:15:29.402654+0000","last_undegraded":"2023-09-28T00:15:29.402654+0000","last_fullsized":"2023-09-28T00:15:29.402654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394457+0000","last_change":"2023-09-28T00:15:29.388253+0000","last_active":"2023-09-28T00:15:29.394457+0000","last_peered":"2023-09-28T00:15:29.394457+0000","last_clean":"2023-09-28T00:15:29.394457+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:15:29.394457+0000","last_undegraded":"2023-09-28T00:15:29.394457+0000","last_fullsized":"2023-09-28T00:15:29.394457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397977+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:15:29.397977+0000","last_peered":"2023-09-28T00:15:29.397977+0000","last_clean":"2023-09-28T00:15:29.397977+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:15:29.397977+0000","last_undegraded":"2023-09-28T00:15:29.397977+0000","last_fullsized":"2023-09-28T00:15:29.397977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400172+0000","last_change":"2023-09-28T00:15:29.399521+0000","last_active":"2023-09-28T00:15:29.400172+0000","last_peered":"2023-09-28T00:15:29.400172+0000","last_clean":"2023-09-28T00:15:29.400172+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:15:29.400172+0000","last_undegraded":"2023-09-28T00:15:29.400172+0000","last_fullsized":"2023-09-28T00:15:29.400172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:38.462117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393250+0000","last_change":"2023-09-28T00:15:29.392028+0000","last_active":"2023-09-28T00:15:29.393250+0000","last_peered":"2023-09-28T00:15:29.393250+0000","last_clean":"2023-09-28T00:15:29.393250+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:15:29.393250+0000","last_undegraded":"2023-09-28T00:15:29.393250+0000","last_fullsized":"2023-09-28T00:15:29.393250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397374+0000","last_change":"2023-09-28T00:15:29.394175+0000","last_active":"2023-09-28T00:15:29.397374+0000","last_peered":"2023-09-28T00:15:29.397374+0000","last_clean":"2023-09-28T00:15:29.397374+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:15:29.397374+0000","last_undegraded":"2023-09-28T00:15:29.397374+0000","last_fullsized":"2023-09-28T00:15:29.397374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394506+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:15:29.394506+0000","last_peered":"2023-09-28T00:15:29.394506+0000","last_clean":"2023-09-28T00:15:29.394506+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:15:29.394506+0000","last_undegraded":"2023-09-28T00:15:29.394506+0000","last_fullsized":"2023-09-28T00:15:29.394506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398296+0000","last_change":"2023-09-28T00:15:29.397273+0000","last_active":"2023-09-28T00:15:29.398296+0000","last_peered":"2023-09-28T00:15:29.398296+0000","last_clean":"2023-09-28T00:15:29.398296+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:15:29.398296+0000","last_undegraded":"2023-09-28T00:15:29.398296+0000","last_fullsized":"2023-09-28T00:15:29.398296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402636+0000","last_change":"2023-09-28T00:15:29.401695+0000","last_active":"2023-09-28T00:15:29.402636+0000","last_peered":"2023-09-28T00:15:29.402636+0000","last_clean":"2023-09-28T00:15:29.402636+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:15:29.402636+0000","last_undegraded":"2023-09-28T00:15:29.402636+0000","last_fullsized":"2023-09-28T00:15:29.402636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400097+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:15:29.400097+0000","last_peered":"2023-09-28T00:15:29.400097+0000","last_clean":"2023-09-28T00:15:29.400097+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:15:29.400097+0000","last_undegraded":"2023-09-28T00:15:29.400097+0000","last_fullsized":"2023-09-28T00:15:29.400097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391545+0000","last_change":"2023-09-28T00:15:29.386237+0000","last_active":"2023-09-28T00:15:29.391545+0000","last_peered":"2023-09-28T00:15:29.391545+0000","last_clean":"2023-09-28T00:15:29.391545+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:15:29.391545+0000","last_undegraded":"2023-09-28T00:15:29.391545+0000","last_fullsized":"2023-09-28T00:15:29.391545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403381+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:15:29.403381+0000","last_peered":"2023-09-28T00:15:29.403381+0000","last_clean":"2023-09-28T00:15:29.403381+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:15:29.403381+0000","last_undegraded":"2023-09-28T00:15:29.403381+0000","last_fullsized":"2023-09-28T00:15:29.403381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:49:33.646923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394054+0000","last_change":"2023-09-28T00:15:29.392231+0000","last_active":"2023-09-28T00:15:29.394054+0000","last_peered":"2023-09-28T00:15:29.394054+0000","last_clean":"2023-09-28T00:15:29.394054+0000","last_became_active":"2023-09-28T00:15:29.391855+0000","last_became_peered":"2023-09-28T00:15:29.391855+0000","last_unstale":"2023-09-28T00:15:29.394054+0000","last_undegraded":"2023-09-28T00:15:29.394054+0000","last_fullsized":"2023-09-28T00:15:29.394054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.401694+0000","last_change":"2023-09-28T00:15:29.394242+0000","last_active":"2023-09-28T00:15:29.401694+0000","last_peered":"2023-09-28T00:15:29.401694+0000","last_clean":"2023-09-28T00:15:29.401694+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:15:29.401694+0000","last_undegraded":"2023-09-28T00:15:29.401694+0000","last_fullsized":"2023-09-28T00:15:29.401694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391666+0000","last_change":"2023-09-28T00:15:29.389082+0000","last_active":"2023-09-28T00:15:29.391666+0000","last_peered":"2023-09-28T00:15:29.391666+0000","last_clean":"2023-09-28T00:15:29.391666+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:15:29.391666+0000","last_undegraded":"2023-09-28T00:15:29.391666+0000","last_fullsized":"2023-09-28T00:15:29.391666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394025+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:15:29.394025+0000","last_peered":"2023-09-28T00:15:29.394025+0000","last_clean":"2023-09-28T00:15:29.394025+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:15:29.394025+0000","last_undegraded":"2023-09-28T00:15:29.394025+0000","last_fullsized":"2023-09-28T00:15:29.394025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398162+0000","last_change":"2023-09-28T00:15:29.392586+0000","last_active":"2023-09-28T00:15:29.398162+0000","last_peered":"2023-09-28T00:15:29.398162+0000","last_clean":"2023-09-28T00:15:29.398162+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:15:29.398162+0000","last_undegraded":"2023-09-28T00:15:29.398162+0000","last_fullsized":"2023-09-28T00:15:29.398162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:16:11.243076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386766+0000","last_change":"2023-09-28T00:15:29.384837+0000","last_active":"2023-09-28T00:15:29.386766+0000","last_peered":"2023-09-28T00:15:29.386766+0000","last_clean":"2023-09-28T00:15:29.386766+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:15:29.386766+0000","last_undegraded":"2023-09-28T00:15:29.386766+0000","last_fullsized":"2023-09-28T00:15:29.386766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:49:32.973094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398577+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:15:29.398577+0000","last_peered":"2023-09-28T00:15:29.398577+0000","last_clean":"2023-09-28T00:15:29.398577+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:15:29.398577+0000","last_undegraded":"2023-09-28T00:15:29.398577+0000","last_fullsized":"2023-09-28T00:15:29.398577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399602+0000","last_change":"2023-09-28T00:15:28.982899+0000","last_active":"2023-09-28T00:15:29.399602+0000","last_peered":"2023-09-28T00:15:29.399602+0000","last_clean":"2023-09-28T00:15:29.399602+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:15:29.399602+0000","last_undegraded":"2023-09-28T00:15:29.399602+0000","last_fullsized":"2023-09-28T00:15:29.399602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390553+0000","last_change":"2023-09-28T00:15:29.383398+0000","last_active":"2023-09-28T00:15:29.390553+0000","last_peered":"2023-09-28T00:15:29.390553+0000","last_clean":"2023-09-28T00:15:29.390553+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:15:29.390553+0000","last_undegraded":"2023-09-28T00:15:29.390553+0000","last_fullsized":"2023-09-28T00:15:29.390553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380346+0000","last_change":"2023-09-28T00:15:28.984308+0000","last_active":"2023-09-28T00:15:29.380346+0000","last_peered":"2023-09-28T00:15:29.380346+0000","last_clean":"2023-09-28T00:15:29.380346+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:15:29.380346+0000","last_undegraded":"2023-09-28T00:15:29.380346+0000","last_fullsized":"2023-09-28T00:15:29.380346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402446+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:15:29.402446+0000","last_peered":"2023-09-28T00:15:29.402446+0000","last_clean":"2023-09-28T00:15:29.402446+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:15:29.402446+0000","last_undegraded":"2023-09-28T00:15:29.402446+0000","last_fullsized":"2023-09-28T00:15:29.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375855+0000","last_change":"2023-09-28T00:15:28.986600+0000","last_active":"2023-09-28T00:15:29.375855+0000","last_peered":"2023-09-28T00:15:29.375855+0000","last_clean":"2023-09-28T00:15:29.375855+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:15:29.375855+0000","last_undegraded":"2023-09-28T00:15:29.375855+0000","last_fullsized":"2023-09-28T00:15:29.375855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397007+0000","last_change":"2023-09-28T00:15:29.391209+0000","last_active":"2023-09-28T00:15:29.397007+0000","last_peered":"2023-09-28T00:15:29.397007+0000","last_clean":"2023-09-28T00:15:29.397007+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:15:29.397007+0000","last_undegraded":"2023-09-28T00:15:29.397007+0000","last_fullsized":"2023-09-28T00:15:29.397007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394579+0000","last_change":"2023-09-28T00:15:28.990492+0000","last_active":"2023-09-28T00:15:29.394579+0000","last_peered":"2023-09-28T00:15:29.394579+0000","last_clean":"2023-09-28T00:15:29.394579+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:15:29.394579+0000","last_undegraded":"2023-09-28T00:15:29.394579+0000","last_fullsized":"2023-09-28T00:15:29.394579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.387663+0000","last_change":"2023-09-28T00:15:29.381022+0000","last_active":"2023-09-28T00:15:29.387663+0000","last_peered":"2023-09-28T00:15:29.387663+0000","last_clean":"2023-09-28T00:15:29.387663+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:15:29.387663+0000","last_undegraded":"2023-09-28T00:15:29.387663+0000","last_fullsized":"2023-09-28T00:15:29.387663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378888+0000","last_change":"2023-09-28T00:15:28.989043+0000","last_active":"2023-09-28T00:15:29.378888+0000","last_peered":"2023-09-28T00:15:29.378888+0000","last_clean":"2023-09-28T00:15:29.378888+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:15:29.378888+0000","last_undegraded":"2023-09-28T00:15:29.378888+0000","last_fullsized":"2023-09-28T00:15:29.378888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391650+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:15:29.391650+0000","last_peered":"2023-09-28T00:15:29.391650+0000","last_clean":"2023-09-28T00:15:29.391650+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:15:29.391650+0000","last_undegraded":"2023-09-28T00:15:29.391650+0000","last_fullsized":"2023-09-28T00:15:29.391650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399129+0000","last_change":"2023-09-28T00:15:28.981865+0000","last_active":"2023-09-28T00:15:29.399129+0000","last_peered":"2023-09-28T00:15:29.399129+0000","last_clean":"2023-09-28T00:15:29.399129+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:15:29.399129+0000","last_undegraded":"2023-09-28T00:15:29.399129+0000","last_fullsized":"2023-09-28T00:15:29.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397590+0000","last_change":"2023-09-28T00:15:29.389604+0000","last_active":"2023-09-28T00:15:29.397590+0000","last_peered":"2023-09-28T00:15:29.397590+0000","last_clean":"2023-09-28T00:15:29.397590+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:15:29.397590+0000","last_undegraded":"2023-09-28T00:15:29.397590+0000","last_fullsized":"2023-09-28T00:15:29.397590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.405038+0000","last_change":"2023-09-28T00:15:28.979093+0000","last_active":"2023-09-28T00:15:29.405038+0000","last_peered":"2023-09-28T00:15:29.405038+0000","last_clean":"2023-09-28T00:15:29.405038+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:15:29.405038+0000","last_undegraded":"2023-09-28T00:15:29.405038+0000","last_fullsized":"2023-09-28T00:15:29.405038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404103+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:15:29.404103+0000","last_peered":"2023-09-28T00:15:29.404103+0000","last_clean":"2023-09-28T00:15:29.404103+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:15:29.404103+0000","last_undegraded":"2023-09-28T00:15:29.404103+0000","last_fullsized":"2023-09-28T00:15:29.404103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:59:40.497846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403068+0000","last_change":"2023-09-28T00:15:28.985348+0000","last_active":"2023-09-28T00:15:29.403068+0000","last_peered":"2023-09-28T00:15:29.403068+0000","last_clean":"2023-09-28T00:15:29.403068+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:15:29.403068+0000","last_undegraded":"2023-09-28T00:15:29.403068+0000","last_fullsized":"2023-09-28T00:15:29.403068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390525+0000","last_change":"2023-09-28T00:15:29.383322+0000","last_active":"2023-09-28T00:15:29.390525+0000","last_peered":"2023-09-28T00:15:29.390525+0000","last_clean":"2023-09-28T00:15:29.390525+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:15:29.390525+0000","last_undegraded":"2023-09-28T00:15:29.390525+0000","last_fullsized":"2023-09-28T00:15:29.390525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390540+0000","last_change":"2023-09-28T00:15:28.987818+0000","last_active":"2023-09-28T00:15:29.390540+0000","last_peered":"2023-09-28T00:15:29.390540+0000","last_clean":"2023-09-28T00:15:29.390540+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:15:29.390540+0000","last_undegraded":"2023-09-28T00:15:29.390540+0000","last_fullsized":"2023-09-28T00:15:29.390540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397462+0000","last_change":"2023-09-28T00:15:29.395546+0000","last_active":"2023-09-28T00:15:29.397462+0000","last_peered":"2023-09-28T00:15:29.397462+0000","last_clean":"2023-09-28T00:15:29.397462+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:15:29.397462+0000","last_undegraded":"2023-09-28T00:15:29.397462+0000","last_fullsized":"2023-09-28T00:15:29.397462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380953+0000","last_change":"2023-09-28T00:15:28.985438+0000","last_active":"2023-09-28T00:15:29.380953+0000","last_peered":"2023-09-28T00:15:29.380953+0000","last_clean":"2023-09-28T00:15:29.380953+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:15:29.380953+0000","last_undegraded":"2023-09-28T00:15:29.380953+0000","last_fullsized":"2023-09-28T00:15:29.380953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402467+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:15:29.402467+0000","last_peered":"2023-09-28T00:15:29.402467+0000","last_clean":"2023-09-28T00:15:29.402467+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:15:29.402467+0000","last_undegraded":"2023-09-28T00:15:29.402467+0000","last_fullsized":"2023-09-28T00:15:29.402467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403755+0000","last_change":"2023-09-28T00:15:28.983275+0000","last_active":"2023-09-28T00:15:29.403755+0000","last_peered":"2023-09-28T00:15:29.403755+0000","last_clean":"2023-09-28T00:15:29.403755+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:15:29.403755+0000","last_undegraded":"2023-09-28T00:15:29.403755+0000","last_fullsized":"2023-09-28T00:15:29.403755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:10:17.162300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396946+0000","last_change":"2023-09-28T00:15:29.393952+0000","last_active":"2023-09-28T00:15:29.396946+0000","last_peered":"2023-09-28T00:15:29.396946+0000","last_clean":"2023-09-28T00:15:29.396946+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:15:29.396946+0000","last_undegraded":"2023-09-28T00:15:29.396946+0000","last_fullsized":"2023-09-28T00:15:29.396946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402648+0000","last_change":"2023-09-28T00:15:28.986391+0000","last_active":"2023-09-28T00:15:29.402648+0000","last_peered":"2023-09-28T00:15:29.402648+0000","last_clean":"2023-09-28T00:15:29.402648+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:15:29.402648+0000","last_undegraded":"2023-09-28T00:15:29.402648+0000","last_fullsized":"2023-09-28T00:15:29.402648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396755+0000","last_change":"2023-09-28T00:15:29.393474+0000","last_active":"2023-09-28T00:15:29.396755+0000","last_peered":"2023-09-28T00:15:29.396755+0000","last_clean":"2023-09-28T00:15:29.396755+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:15:29.396755+0000","last_undegraded":"2023-09-28T00:15:29.396755+0000","last_fullsized":"2023-09-28T00:15:29.396755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402943+0000","last_change":"2023-09-28T00:15:28.986082+0000","last_active":"2023-09-28T00:15:29.402943+0000","last_peered":"2023-09-28T00:15:29.402943+0000","last_clean":"2023-09-28T00:15:29.402943+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:15:29.402943+0000","last_undegraded":"2023-09-28T00:15:29.402943+0000","last_fullsized":"2023-09-28T00:15:29.402943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:16.392360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397610+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:15:29.397610+0000","last_peered":"2023-09-28T00:15:29.397610+0000","last_clean":"2023-09-28T00:15:29.397610+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:15:29.397610+0000","last_undegraded":"2023-09-28T00:15:29.397610+0000","last_fullsized":"2023-09-28T00:15:29.397610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:11:37.490848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399248+0000","last_change":"2023-09-28T00:15:28.982433+0000","last_active":"2023-09-28T00:15:29.399248+0000","last_peered":"2023-09-28T00:15:29.399248+0000","last_clean":"2023-09-28T00:15:29.399248+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:15:29.399248+0000","last_undegraded":"2023-09-28T00:15:29.399248+0000","last_fullsized":"2023-09-28T00:15:29.399248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:37:52.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395572+0000","last_change":"2023-09-28T00:15:29.388766+0000","last_active":"2023-09-28T00:15:29.395572+0000","last_peered":"2023-09-28T00:15:29.395572+0000","last_clean":"2023-09-28T00:15:29.395572+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:15:29.395572+0000","last_undegraded":"2023-09-28T00:15:29.395572+0000","last_fullsized":"2023-09-28T00:15:29.395572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.381202+0000","last_change":"2023-09-28T00:15:28.984089+0000","last_active":"2023-09-28T00:15:29.381202+0000","last_peered":"2023-09-28T00:15:29.381202+0000","last_clean":"2023-09-28T00:15:29.381202+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:15:29.381202+0000","last_undegraded":"2023-09-28T00:15:29.381202+0000","last_fullsized":"2023-09-28T00:15:29.381202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394391+0000","last_change":"2023-09-28T00:15:29.386850+0000","last_active":"2023-09-28T00:15:29.394391+0000","last_peered":"2023-09-28T00:15:29.394391+0000","last_clean":"2023-09-28T00:15:29.394391+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:15:29.394391+0000","last_undegraded":"2023-09-28T00:15:29.394391+0000","last_fullsized":"2023-09-28T00:15:29.394391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402306+0000","last_change":"2023-09-28T00:15:28.986069+0000","last_active":"2023-09-28T00:15:29.402306+0000","last_peered":"2023-09-28T00:15:29.402306+0000","last_clean":"2023-09-28T00:15:29.402306+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:15:29.402306+0000","last_undegraded":"2023-09-28T00:15:29.402306+0000","last_fullsized":"2023-09-28T00:15:29.402306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397756+0000","last_change":"2023-09-28T00:15:29.393182+0000","last_active":"2023-09-28T00:15:29.397756+0000","last_peered":"2023-09-28T00:15:29.397756+0000","last_clean":"2023-09-28T00:15:29.397756+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:15:29.397756+0000","last_undegraded":"2023-09-28T00:15:29.397756+0000","last_fullsized":"2023-09-28T00:15:29.397756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385144+0000","last_change":"2023-09-28T00:15:28.985291+0000","last_active":"2023-09-28T00:15:29.385144+0000","last_peered":"2023-09-28T00:15:29.385144+0000","last_clean":"2023-09-28T00:15:29.385144+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:15:29.385144+0000","last_undegraded":"2023-09-28T00:15:29.385144+0000","last_fullsized":"2023-09-28T00:15:29.385144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404083+0000","last_change":"2023-09-28T00:15:29.400083+0000","last_active":"2023-09-28T00:15:29.404083+0000","last_peered":"2023-09-28T00:15:29.404083+0000","last_clean":"2023-09-28T00:15:29.404083+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:15:29.404083+0000","last_undegraded":"2023-09-28T00:15:29.404083+0000","last_fullsized":"2023-09-28T00:15:29.404083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385946+0000","last_change":"2023-09-28T00:15:28.980715+0000","last_active":"2023-09-28T00:15:29.385946+0000","last_peered":"2023-09-28T00:15:29.385946+0000","last_clean":"2023-09-28T00:15:29.385946+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:15:29.385946+0000","last_undegraded":"2023-09-28T00:15:29.385946+0000","last_fullsized":"2023-09-28T00:15:29.385946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400065+0000","last_change":"2023-09-28T00:15:29.397875+0000","last_active":"2023-09-28T00:15:29.400065+0000","last_peered":"2023-09-28T00:15:29.400065+0000","last_clean":"2023-09-28T00:15:29.400065+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:15:29.400065+0000","last_undegraded":"2023-09-28T00:15:29.400065+0000","last_fullsized":"2023-09-28T00:15:29.400065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:35:06.112174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375411+0000","last_change":"2023-09-28T00:15:28.986410+0000","last_active":"2023-09-28T00:15:29.375411+0000","last_peered":"2023-09-28T00:15:29.375411+0000","last_clean":"2023-09-28T00:15:29.375411+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:15:29.375411+0000","last_undegraded":"2023-09-28T00:15:29.375411+0000","last_fullsized":"2023-09-28T00:15:29.375411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398187+0000","last_change":"2023-09-28T00:15:29.392748+0000","last_active":"2023-09-28T00:15:29.398187+0000","last_peered":"2023-09-28T00:15:29.398187+0000","last_clean":"2023-09-28T00:15:29.398187+0000","last_became_active":"2023-09-28T00:15:29.392336+0000","last_became_peered":"2023-09-28T00:15:29.392336+0000","last_unstale":"2023-09-28T00:15:29.398187+0000","last_undegraded":"2023-09-28T00:15:29.398187+0000","last_fullsized":"2023-09-28T00:15:29.398187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380356+0000","last_change":"2023-09-28T00:15:24.193273+0000","last_active":"2023-09-28T00:15:29.380356+0000","last_peered":"2023-09-28T00:15:29.380356+0000","last_clean":"2023-09-28T00:15:29.380356+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:15:29.380356+0000","last_undegraded":"2023-09-28T00:15:29.380356+0000","last_fullsized":"2023-09-28T00:15:29.380356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:55:44.401134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379326+0000","last_change":"2023-09-28T00:15:28.986194+0000","last_active":"2023-09-28T00:15:29.379326+0000","last_peered":"2023-09-28T00:15:29.379326+0000","last_clean":"2023-09-28T00:15:29.379326+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:15:29.379326+0000","last_undegraded":"2023-09-28T00:15:29.379326+0000","last_fullsized":"2023-09-28T00:15:29.379326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390889+0000","last_change":"2023-09-28T00:15:29.388604+0000","last_active":"2023-09-28T00:15:29.390889+0000","last_peered":"2023-09-28T00:15:29.390889+0000","last_clean":"2023-09-28T00:15:29.390889+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:15:29.390889+0000","last_undegraded":"2023-09-28T00:15:29.390889+0000","last_fullsized":"2023-09-28T00:15:29.390889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378226+0000","last_change":"2023-09-28T00:15:23.950475+0000","last_active":"2023-09-28T00:15:29.378226+0000","last_peered":"2023-09-28T00:15:29.378226+0000","last_clean":"2023-09-28T00:15:29.378226+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:15:29.378226+0000","last_undegraded":"2023-09-28T00:15:29.378226+0000","last_fullsized":"2023-09-28T00:15:29.378226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386282+0000","last_change":"2023-09-28T00:15:28.984604+0000","last_active":"2023-09-28T00:15:29.386282+0000","last_peered":"2023-09-28T00:15:29.386282+0000","last_clean":"2023-09-28T00:15:29.386282+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:15:29.386282+0000","last_undegraded":"2023-09-28T00:15:29.386282+0000","last_fullsized":"2023-09-28T00:15:29.386282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398171+0000","last_change":"2023-09-28T00:15:29.392616+0000","last_active":"2023-09-28T00:15:29.398171+0000","last_peered":"2023-09-28T00:15:29.398171+0000","last_clean":"2023-09-28T00:15:29.398171+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:15:29.398171+0000","last_undegraded":"2023-09-28T00:15:29.398171+0000","last_fullsized":"2023-09-28T00:15:29.398171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:20:56.060002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379003+0000","last_change":"2023-09-28T00:15:24.193731+0000","last_active":"2023-09-28T00:15:29.379003+0000","last_peered":"2023-09-28T00:15:29.379003+0000","last_clean":"2023-09-28T00:15:29.379003+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:15:29.379003+0000","last_undegraded":"2023-09-28T00:15:29.379003+0000","last_fullsized":"2023-09-28T00:15:29.379003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:10:07.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378537+0000","last_change":"2023-09-28T00:15:28.980294+0000","last_active":"2023-09-28T00:15:29.378537+0000","last_peered":"2023-09-28T00:15:29.378537+0000","last_clean":"2023-09-28T00:15:29.378537+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:15:29.378537+0000","last_undegraded":"2023-09-28T00:15:29.378537+0000","last_fullsized":"2023-09-28T00:15:29.378537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390883+0000","last_change":"2023-09-28T00:15:29.388008+0000","last_active":"2023-09-28T00:15:29.390883+0000","last_peered":"2023-09-28T00:15:29.390883+0000","last_clean":"2023-09-28T00:15:29.390883+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:15:29.390883+0000","last_undegraded":"2023-09-28T00:15:29.390883+0000","last_fullsized":"2023-09-28T00:15:29.390883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.377855+0000","last_change":"2023-09-28T00:15:23.950457+0000","last_active":"2023-09-28T00:15:29.377855+0000","last_peered":"2023-09-28T00:15:29.377855+0000","last_clean":"2023-09-28T00:15:29.377855+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:15:29.377855+0000","last_undegraded":"2023-09-28T00:15:29.377855+0000","last_fullsized":"2023-09-28T00:15:29.377855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380256+0000","last_change":"2023-09-28T00:15:16.995081+0000","last_active":"2023-09-28T00:15:29.380256+0000","last_peered":"2023-09-28T00:15:29.380256+0000","last_clean":"2023-09-28T00:15:29.380256+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:15:29.380256+0000","last_undegraded":"2023-09-28T00:15:29.380256+0000","last_fullsized":"2023-09-28T00:15:29.380256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_clean_scrub_stamp":"2023-09-28T00:15:15.867916+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:37:49.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375538+0000","last_change":"2023-09-28T00:15:28.985016+0000","last_active":"2023-09-28T00:15:29.375538+0000","last_peered":"2023-09-28T00:15:29.375538+0000","last_clean":"2023-09-28T00:15:29.375538+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:15:29.375538+0000","last_undegraded":"2023-09-28T00:15:29.375538+0000","last_fullsized":"2023-09-28T00:15:29.375538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403095+0000","last_change":"2023-09-28T00:15:29.401863+0000","last_active":"2023-09-28T00:15:29.403095+0000","last_peered":"2023-09-28T00:15:29.403095+0000","last_clean":"2023-09-28T00:15:29.403095+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:15:29.403095+0000","last_undegraded":"2023-09-28T00:15:29.403095+0000","last_fullsized":"2023-09-28T00:15:29.403095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:17.400054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380675+0000","last_change":"2023-09-28T00:15:23.946737+0000","last_active":"2023-09-28T00:15:29.380675+0000","last_peered":"2023-09-28T00:15:29.380675+0000","last_clean":"2023-09-28T00:15:29.380675+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:15:29.380675+0000","last_undegraded":"2023-09-28T00:15:29.380675+0000","last_fullsized":"2023-09-28T00:15:29.380675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386570+0000","last_change":"2023-09-28T00:15:28.986464+0000","last_active":"2023-09-28T00:15:29.386570+0000","last_peered":"2023-09-28T00:15:29.386570+0000","last_clean":"2023-09-28T00:15:29.386570+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:15:29.386570+0000","last_undegraded":"2023-09-28T00:15:29.386570+0000","last_fullsized":"2023-09-28T00:15:29.386570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398876+0000","last_change":"2023-09-28T00:15:29.390313+0000","last_active":"2023-09-28T00:15:29.398876+0000","last_peered":"2023-09-28T00:15:29.398876+0000","last_clean":"2023-09-28T00:15:29.398876+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:15:29.398876+0000","last_undegraded":"2023-09-28T00:15:29.398876+0000","last_fullsized":"2023-09-28T00:15:29.398876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379277+0000","last_change":"2023-09-28T00:15:24.193260+0000","last_active":"2023-09-28T00:15:29.379277+0000","last_peered":"2023-09-28T00:15:29.379277+0000","last_clean":"2023-09-28T00:15:29.379277+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:15:29.379277+0000","last_undegraded":"2023-09-28T00:15:29.379277+0000","last_fullsized":"2023-09-28T00:15:29.379277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380464+0000","last_change":"2023-09-28T00:15:28.979725+0000","last_active":"2023-09-28T00:15:29.380464+0000","last_peered":"2023-09-28T00:15:29.380464+0000","last_clean":"2023-09-28T00:15:29.380464+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:15:29.380464+0000","last_undegraded":"2023-09-28T00:15:29.380464+0000","last_fullsized":"2023-09-28T00:15:29.380464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402412+0000","last_change":"2023-09-28T00:15:29.398984+0000","last_active":"2023-09-28T00:15:29.402412+0000","last_peered":"2023-09-28T00:15:29.402412+0000","last_clean":"2023-09-28T00:15:29.402412+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:15:29.402412+0000","last_undegraded":"2023-09-28T00:15:29.402412+0000","last_fullsized":"2023-09-28T00:15:29.402412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395338+0000","last_change":"2023-09-28T00:15:28.989236+0000","last_active":"2023-09-28T00:15:29.395338+0000","last_peered":"2023-09-28T00:15:29.395338+0000","last_clean":"2023-09-28T00:15:29.395338+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:15:29.395338+0000","last_undegraded":"2023-09-28T00:15:29.395338+0000","last_fullsized":"2023-09-28T00:15:29.395338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380630+0000","last_change":"2023-09-28T00:15:23.949425+0000","last_active":"2023-09-28T00:15:29.380630+0000","last_peered":"2023-09-28T00:15:29.380630+0000","last_clean":"2023-09-28T00:15:29.380630+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:15:29.380630+0000","last_undegraded":"2023-09-28T00:15:29.380630+0000","last_fullsized":"2023-09-28T00:15:29.380630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:59:04.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391469+0000","last_change":"2023-09-28T00:15:29.386508+0000","last_active":"2023-09-28T00:15:29.391469+0000","last_peered":"2023-09-28T00:15:29.391469+0000","last_clean":"2023-09-28T00:15:29.391469+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:15:29.391469+0000","last_undegraded":"2023-09-28T00:15:29.391469+0000","last_fullsized":"2023-09-28T00:15:29.391469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385234+0000","last_change":"2023-09-28T00:15:23.949692+0000","last_active":"2023-09-28T00:15:29.385234+0000","last_peered":"2023-09-28T00:15:29.385234+0000","last_clean":"2023-09-28T00:15:29.385234+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:15:29.385234+0000","last_undegraded":"2023-09-28T00:15:29.385234+0000","last_fullsized":"2023-09-28T00:15:29.385234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:48:11.275095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778335+0000","last_change":"2023-09-28T00:15:28.988077+0000","last_active":"2023-09-28T00:15:30.778335+0000","last_peered":"2023-09-28T00:15:30.778335+0000","last_clean":"2023-09-28T00:15:30.778335+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:15:30.778335+0000","last_undegraded":"2023-09-28T00:15:30.778335+0000","last_fullsized":"2023-09-28T00:15:30.778335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399373+0000","last_change":"2023-09-28T00:15:29.398170+0000","last_active":"2023-09-28T00:15:29.399373+0000","last_peered":"2023-09-28T00:15:29.399373+0000","last_clean":"2023-09-28T00:15:29.399373+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:15:29.399373+0000","last_undegraded":"2023-09-28T00:15:29.399373+0000","last_fullsized":"2023-09-28T00:15:29.399373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:30:23.382889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402252+0000","last_change":"2023-09-28T00:15:28.987224+0000","last_active":"2023-09-28T00:15:29.402252+0000","last_peered":"2023-09-28T00:15:29.402252+0000","last_clean":"2023-09-28T00:15:29.402252+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:15:29.402252+0000","last_undegraded":"2023-09-28T00:15:29.402252+0000","last_fullsized":"2023-09-28T00:15:29.402252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391371+0000","last_change":"2023-09-28T00:15:29.383759+0000","last_active":"2023-09-28T00:15:29.391371+0000","last_peered":"2023-09-28T00:15:29.391371+0000","last_clean":"2023-09-28T00:15:29.391371+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:15:29.391371+0000","last_undegraded":"2023-09-28T00:15:29.391371+0000","last_fullsized":"2023-09-28T00:15:29.391371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:06.286162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402275+0000","last_change":"2023-09-28T00:15:28.987633+0000","last_active":"2023-09-28T00:15:29.402275+0000","last_peered":"2023-09-28T00:15:29.402275+0000","last_clean":"2023-09-28T00:15:29.402275+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:15:29.402275+0000","last_undegraded":"2023-09-28T00:15:29.402275+0000","last_fullsized":"2023-09-28T00:15:29.402275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398131+0000","last_change":"2023-09-28T00:15:29.392897+0000","last_active":"2023-09-28T00:15:29.398131+0000","last_peered":"2023-09-28T00:15:29.398131+0000","last_clean":"2023-09-28T00:15:29.398131+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:15:29.398131+0000","last_undegraded":"2023-09-28T00:15:29.398131+0000","last_fullsized":"2023-09-28T00:15:29.398131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403684+0000","last_change":"2023-09-28T00:15:28.987962+0000","last_active":"2023-09-28T00:15:29.403684+0000","last_peered":"2023-09-28T00:15:29.403684+0000","last_clean":"2023-09-28T00:15:29.403684+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:15:29.403684+0000","last_undegraded":"2023-09-28T00:15:29.403684+0000","last_fullsized":"2023-09-28T00:15:29.403684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399076+0000","last_change":"2023-09-28T00:15:29.394598+0000","last_active":"2023-09-28T00:15:29.399076+0000","last_peered":"2023-09-28T00:15:29.399076+0000","last_clean":"2023-09-28T00:15:29.399076+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:15:29.399076+0000","last_undegraded":"2023-09-28T00:15:29.399076+0000","last_fullsized":"2023-09-28T00:15:29.399076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396285+0000","last_change":"2023-09-28T00:15:28.983686+0000","last_active":"2023-09-28T00:15:29.396285+0000","last_peered":"2023-09-28T00:15:29.396285+0000","last_clean":"2023-09-28T00:15:29.396285+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:15:29.396285+0000","last_undegraded":"2023-09-28T00:15:29.396285+0000","last_fullsized":"2023-09-28T00:15:29.396285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391633+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:15:29.391633+0000","last_peered":"2023-09-28T00:15:29.391633+0000","last_clean":"2023-09-28T00:15:29.391633+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:15:29.391633+0000","last_undegraded":"2023-09-28T00:15:29.391633+0000","last_fullsized":"2023-09-28T00:15:29.391633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402519+0000","last_change":"2023-09-28T00:15:28.985280+0000","last_active":"2023-09-28T00:15:29.402519+0000","last_peered":"2023-09-28T00:15:29.402519+0000","last_clean":"2023-09-28T00:15:29.402519+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:15:29.402519+0000","last_undegraded":"2023-09-28T00:15:29.402519+0000","last_fullsized":"2023-09-28T00:15:29.402519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400030+0000","last_change":"2023-09-28T00:15:29.398360+0000","last_active":"2023-09-28T00:15:29.400030+0000","last_peered":"2023-09-28T00:15:29.400030+0000","last_clean":"2023-09-28T00:15:29.400030+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:15:29.400030+0000","last_undegraded":"2023-09-28T00:15:29.400030+0000","last_fullsized":"2023-09-28T00:15:29.400030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:58:13.878285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400854+0000","last_change":"2023-09-28T00:15:29.395080+0000","last_active":"2023-09-28T00:15:29.400854+0000","last_peered":"2023-09-28T00:15:29.400854+0000","last_clean":"2023-09-28T00:15:29.400854+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:15:29.400854+0000","last_undegraded":"2023-09-28T00:15:29.400854+0000","last_fullsized":"2023-09-28T00:15:29.400854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:39.792299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391615+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:15:29.391615+0000","last_peered":"2023-09-28T00:15:29.391615+0000","last_clean":"2023-09-28T00:15:29.391615+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:15:29.391615+0000","last_undegraded":"2023-09-28T00:15:29.391615+0000","last_fullsized":"2023-09-28T00:15:29.391615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403283+0000","last_change":"2023-09-28T00:15:29.399203+0000","last_active":"2023-09-28T00:15:29.403283+0000","last_peered":"2023-09-28T00:15:29.403283+0000","last_clean":"2023-09-28T00:15:29.403283+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:15:29.403283+0000","last_undegraded":"2023-09-28T00:15:29.403283+0000","last_fullsized":"2023-09-28T00:15:29.403283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:47:48.079491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391392+0000","last_change":"2023-09-28T00:15:29.388644+0000","last_active":"2023-09-28T00:15:29.391392+0000","last_peered":"2023-09-28T00:15:29.391392+0000","last_clean":"2023-09-28T00:15:29.391392+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:15:29.391392+0000","last_undegraded":"2023-09-28T00:15:29.391392+0000","last_fullsized":"2023-09-28T00:15:29.391392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390790+0000","last_change":"2023-09-28T00:15:29.388432+0000","last_active":"2023-09-28T00:15:29.390790+0000","last_peered":"2023-09-28T00:15:29.390790+0000","last_clean":"2023-09-28T00:15:29.390790+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:15:29.390790+0000","last_undegraded":"2023-09-28T00:15:29.390790+0000","last_fullsized":"2023-09-28T00:15:29.390790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8004,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363836,"statfs":{"total":96636764160,"available":96628568064,"internally_reserved":0,"allocated":258048,"data_stored":93762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9092,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362748,"statfs":{"total":96636764160,"available":96627453952,"internally_reserved":0,"allocated":847872,"data_stored":684060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9116,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362724,"statfs":{"total":96636764160,"available":96627429376,"internally_reserved":0,"allocated":872448,"data_stored":685258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7932,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363908,"statfs":{"total":96636764160,"available":96628641792,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":93228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":270336,"data_stored":94730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:15:45.745 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-28T00:15:45.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:15:45.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.898+0000 7f99d2900700 1 Processor -- start 2023-09-28T00:15:45.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.898+0000 7f99d2900700 1 -- start start 2023-09-28T00:15:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.899+0000 7f99d2900700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0cdc00 0x7f99cc0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.899+0000 7f99d2900700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0ae140 con 0x7f99cc0d1030 2023-09-28T00:15:45.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.899+0000 7f99d2900700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0ad530 con 0x7f99cc0c6dc0 2023-09-28T00:15:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.899+0000 7f99d2900700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0cc390 con 0x7f99cc0cdc00 2023-09-28T00:15:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.899+0000 7f99cb7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f99cc0d1030 0x7f99cc0c66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49250/0 (socket says 172.21.15.26:49250) 2023-09-28T00:15:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.899+0000 7f99cb7fe700 1 -- 172.21.15.26:0/3524377446 learned_addr learned my addr 172.21.15.26:0/3524377446 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99cbfff700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0cdc00 0x7f99cc0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345055093 0 0) 0x7f99cc0ae140 con 0x7f99cc0d1030 2023-09-28T00:15:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99b4003570 con 0x7f99cc0d1030 2023-09-28T00:15:45.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455052136 0 0) 0x7f99cc0ad530 con 0x7f99cc0c6dc0 2023-09-28T00:15:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99cc0ae140 con 0x7f99cc0c6dc0 2023-09-28T00:15:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1387654233 0 0) 0x7f99b4003570 con 0x7f99cc0d1030 2023-09-28T00:15:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0cdc00 msgr2=0x7f99cc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0cdc00 0x7f99cc0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 >> v1:172.21.15.190:6789/0 conn(0x7f99cc0c6dc0 legacy=0x7f99cc0ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0ad810 con 0x7f99cc0d1030 2023-09-28T00:15:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7f99c0001470 con 0x7f99cc0d1030 2023-09-28T00:15:45.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 >> v1:172.21.15.26:6789/0 conn(0x7f99cc0d1030 legacy=0x7f99cc0c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99b4003c20 0x7f99b4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b4004810 0x7f99b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0cdc00 0x7f99b4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0cc390 con 0x7f99b4004810 2023-09-28T00:15:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b400bb90 con 0x7f99b4003c20 2023-09-28T00:15:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b400bd50 con 0x7f99cc0cdc00 2023-09-28T00:15:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99cb7fe700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b4004810 0x7f99b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99cbfff700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99b4003c20 0x7f99b4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99d0e9d700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0cdc00 0x7f99b4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.900+0000 7f99cb7fe700 1 -- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0cdc00 msgr2=0x7f99b4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:45.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99cb7fe700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99cc0cdc00 0x7f99b4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99cb7fe700 1 -- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99b4003c20 msgr2=0x7f99b4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:45.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99cb7fe700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99b4003c20 0x7f99b4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99cb7fe700 1 -- 172.21.15.26:0/3524377446 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b4003570 con 0x7f99b4004810 2023-09-28T00:15:45.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99cb7fe700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b4004810 0x7f99b4004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c2d0 tx=0x7f99c0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78fbc4374e30e2e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:45.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c000cba0 con 0x7f99b4004810 2023-09-28T00:15:45.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c000cd00 con 0x7f99b4004810 2023-09-28T00:15:45.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99caffd700 1 -- 172.21.15.26:0/3524377446 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0005b70 con 0x7f99b4004810 2023-09-28T00:15:45.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99d2900700 1 -- 172.21.15.26:0/3524377446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b4004810 msgr2=0x7f99b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99d2900700 1 --2- 172.21.15.26:0/3524377446 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b4004810 0x7f99b4004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99c000c2d0 tx=0x7f99c0001e10 comp rx=0 tx=0).stop 2023-09-28T00:15:45.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99d0e9d700 1 -- 172.21.15.26:0/3524377446 reap_dead start 2023-09-28T00:15:45.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99d2900700 1 -- 172.21.15.26:0/3524377446 shutdown_connections 2023-09-28T00:15:45.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99d2900700 1 -- 172.21.15.26:0/3524377446 >> 172.21.15.26:0/3524377446 conn(0x7f99cc099990 msgr2=0x7f99cc0b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:45.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99d2900700 1 -- 172.21.15.26:0/3524377446 shutdown_connections 2023-09-28T00:15:45.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.901+0000 7f99d2900700 1 -- 172.21.15.26:0/3524377446 wait complete. 2023-09-28T00:15:45.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.903+0000 7f99d2900700 1 Processor -- start 2023-09-28T00:15:45.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.903+0000 7f99d2900700 1 -- start start 2023-09-28T00:15:45.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.903+0000 7f99d2900700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b4004810 0x7f99cc149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.903+0000 7f99d2900700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc16a670 0x7f99cc09adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.903+0000 7f99d2900700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99cc09c880 0x7f99cc068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.903+0000 7f99d2900700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc09b7e0 con 0x7f99cc09c880 2023-09-28T00:15:45.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.903+0000 7f99d2900700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc09bac0 con 0x7f99cc16a670 2023-09-28T00:15:45.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.903+0000 7f99d2900700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc09bda0 con 0x7f99b4004810 2023-09-28T00:15:45.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d0e9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99cc09c880 0x7f99cc068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d0e9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99cc09c880 0x7f99cc068c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40122/0 (socket says 172.21.15.26:40122) 2023-09-28T00:15:45.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d0e9d700 1 -- 172.21.15.26:0/2336690680 learned_addr learned my addr 172.21.15.26:0/2336690680 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:45.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99cbfff700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b4004810 0x7f99cc149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99cb7fe700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc16a670 0x7f99cc09adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d0e9d700 1 -- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b4004810 msgr2=0x7f99cc149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d0e9d700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b4004810 0x7f99cc149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d0e9d700 1 -- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc16a670 msgr2=0x7f99cc09adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:45.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d0e9d700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc16a670 0x7f99cc09adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d0e9d700 1 -- 172.21.15.26:0/2336690680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc09c080 con 0x7f99cc09c880 2023-09-28T00:15:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99cbfff700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b4004810 0x7f99cc149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99cb7fe700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc16a670 0x7f99cc09adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d0e9d700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99cc09c880 0x7f99cc068c70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99c4007fd0 tx=0x7f99c4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99b3fff700 1 -- 172.21.15.26:0/2336690680 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4006db0 con 0x7f99cc09c880 2023-09-28T00:15:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99b3fff700 1 -- 172.21.15.26:0/2336690680 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c4003110 con 0x7f99cc09c880 2023-09-28T00:15:45.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc09c360 con 0x7f99cc09c880 2023-09-28T00:15:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99b3fff700 1 -- 172.21.15.26:0/2336690680 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c40034d0 con 0x7f99cc09c880 2023-09-28T00:15:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.904+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc09cd20 con 0x7f99cc09c880 2023-09-28T00:15:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.905+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc064050 con 0x7f99cc09c880 2023-09-28T00:15:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.906+0000 7f99b3fff700 1 -- 172.21.15.26:0/2336690680 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f99c40018f0 con 0x7f99cc09c880 2023-09-28T00:15:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.906+0000 7f99b3fff700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f99b8067330 0x7f99b80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.906+0000 7f99b3fff700 1 -- 172.21.15.26:0/2336690680 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f99c4084470 con 0x7f99cc09c880 2023-09-28T00:15:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.906+0000 7f99cbfff700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f99b8067330 0x7f99b80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.907+0000 7f99cbfff700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f99b8067330 0x7f99b80697e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f99cc09d410 tx=0x7f99bc009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:45.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:45.910+0000 7f99b3fff700 1 -- 172.21.15.26:0/2336690680 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f99c404c570 con 0x7f99cc09c880 2023-09-28T00:15:46.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.102+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99cc0ca7c0 con 0x7f99b8067330 2023-09-28T00:15:46.111 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.111+0000 7f99b3fff700 1 -- 172.21.15.26:0/2336690680 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284675 (secure 0 0 0) 0x7f99cc0ca7c0 con 0x7f99b8067330 2023-09-28T00:15:46.115 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:46.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f99b8067330 msgr2=0x7f99b80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:46.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f99b8067330 0x7f99b80697e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f99cc09d410 tx=0x7f99bc009120 comp rx=0 tx=0).stop 2023-09-28T00:15:46.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99cc09c880 msgr2=0x7f99cc068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:46.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99cc09c880 0x7f99cc068c70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99c4007fd0 tx=0x7f99c4009040 comp rx=0 tx=0).stop 2023-09-28T00:15:46.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 shutdown_connections 2023-09-28T00:15:46.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f99b8067330 0x7f99b80697e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f99b4004810 0x7f99cc149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99cc09c880 0x7f99cc068c70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 --2- 172.21.15.26:0/2336690680 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f99cc16a670 0x7f99cc09adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 >> 172.21.15.26:0/2336690680 conn(0x7f99cc099990 msgr2=0x7f99cc0cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:46.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 shutdown_connections 2023-09-28T00:15:46.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.114+0000 7f99d2900700 1 -- 172.21.15.26:0/2336690680 wait complete. 2023-09-28T00:15:46.118 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:15:46.127 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-09-28T00:15:45.671828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66344,"kb_used_data":3176,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908376,"statfs":{"total":773094113280,"available":773026177024,"internally_reserved":0,"allocated":3252224,"data_stored":1930452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003393"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393167+0000","last_change":"2023-09-28T00:15:29.392083+0000","last_active":"2023-09-28T00:15:29.393167+0000","last_peered":"2023-09-28T00:15:29.393167+0000","last_clean":"2023-09-28T00:15:29.393167+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:15:29.393167+0000","last_undegraded":"2023-09-28T00:15:29.393167+0000","last_fullsized":"2023-09-28T00:15:29.393167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:53.756849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391806+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:15:29.391806+0000","last_peered":"2023-09-28T00:15:29.391806+0000","last_clean":"2023-09-28T00:15:29.391806+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:15:29.391806+0000","last_undegraded":"2023-09-28T00:15:29.391806+0000","last_fullsized":"2023-09-28T00:15:29.391806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404174+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:15:29.404174+0000","last_peered":"2023-09-28T00:15:29.404174+0000","last_clean":"2023-09-28T00:15:29.404174+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:15:29.404174+0000","last_undegraded":"2023-09-28T00:15:29.404174+0000","last_fullsized":"2023-09-28T00:15:29.404174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:31:15.779086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394940+0000","last_change":"2023-09-28T00:15:29.387338+0000","last_active":"2023-09-28T00:15:29.394940+0000","last_peered":"2023-09-28T00:15:29.394940+0000","last_clean":"2023-09-28T00:15:29.394940+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:15:29.394940+0000","last_undegraded":"2023-09-28T00:15:29.394940+0000","last_fullsized":"2023-09-28T00:15:29.394940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:11.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402390+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:15:29.402390+0000","last_peered":"2023-09-28T00:15:29.402390+0000","last_clean":"2023-09-28T00:15:29.402390+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:15:29.402390+0000","last_undegraded":"2023-09-28T00:15:29.402390+0000","last_fullsized":"2023-09-28T00:15:29.402390+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403262+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:15:29.403262+0000","last_peered":"2023-09-28T00:15:29.403262+0000","last_clean":"2023-09-28T00:15:29.403262+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:15:29.403262+0000","last_undegraded":"2023-09-28T00:15:29.403262+0000","last_fullsized":"2023-09-28T00:15:29.403262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:10.975572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390765+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:15:29.390765+0000","last_peered":"2023-09-28T00:15:29.390765+0000","last_clean":"2023-09-28T00:15:29.390765+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:15:29.390765+0000","last_undegraded":"2023-09-28T00:15:29.390765+0000","last_fullsized":"2023-09-28T00:15:29.390765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399845+0000","last_change":"2023-09-28T00:15:29.398742+0000","last_active":"2023-09-28T00:15:29.399845+0000","last_peered":"2023-09-28T00:15:29.399845+0000","last_clean":"2023-09-28T00:15:29.399845+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:15:29.399845+0000","last_undegraded":"2023-09-28T00:15:29.399845+0000","last_fullsized":"2023-09-28T00:15:29.399845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402654+0000","last_change":"2023-09-28T00:15:29.401666+0000","last_active":"2023-09-28T00:15:29.402654+0000","last_peered":"2023-09-28T00:15:29.402654+0000","last_clean":"2023-09-28T00:15:29.402654+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:15:29.402654+0000","last_undegraded":"2023-09-28T00:15:29.402654+0000","last_fullsized":"2023-09-28T00:15:29.402654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394457+0000","last_change":"2023-09-28T00:15:29.388253+0000","last_active":"2023-09-28T00:15:29.394457+0000","last_peered":"2023-09-28T00:15:29.394457+0000","last_clean":"2023-09-28T00:15:29.394457+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:15:29.394457+0000","last_undegraded":"2023-09-28T00:15:29.394457+0000","last_fullsized":"2023-09-28T00:15:29.394457+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397977+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:15:29.397977+0000","last_peered":"2023-09-28T00:15:29.397977+0000","last_clean":"2023-09-28T00:15:29.397977+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:15:29.397977+0000","last_undegraded":"2023-09-28T00:15:29.397977+0000","last_fullsized":"2023-09-28T00:15:29.397977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400172+0000","last_change":"2023-09-28T00:15:29.399521+0000","last_active":"2023-09-28T00:15:29.400172+0000","last_peered":"2023-09-28T00:15:29.400172+0000","last_clean":"2023-09-28T00:15:29.400172+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:15:29.400172+0000","last_undegraded":"2023-09-28T00:15:29.400172+0000","last_fullsized":"2023-09-28T00:15:29.400172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:38.462117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.393250+0000","last_change":"2023-09-28T00:15:29.392028+0000","last_active":"2023-09-28T00:15:29.393250+0000","last_peered":"2023-09-28T00:15:29.393250+0000","last_clean":"2023-09-28T00:15:29.393250+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:15:29.393250+0000","last_undegraded":"2023-09-28T00:15:29.393250+0000","last_fullsized":"2023-09-28T00:15:29.393250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397374+0000","last_change":"2023-09-28T00:15:29.394175+0000","last_active":"2023-09-28T00:15:29.397374+0000","last_peered":"2023-09-28T00:15:29.397374+0000","last_clean":"2023-09-28T00:15:29.397374+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:15:29.397374+0000","last_undegraded":"2023-09-28T00:15:29.397374+0000","last_fullsized":"2023-09-28T00:15:29.397374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394506+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:15:29.394506+0000","last_peered":"2023-09-28T00:15:29.394506+0000","last_clean":"2023-09-28T00:15:29.394506+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:15:29.394506+0000","last_undegraded":"2023-09-28T00:15:29.394506+0000","last_fullsized":"2023-09-28T00:15:29.394506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398296+0000","last_change":"2023-09-28T00:15:29.397273+0000","last_active":"2023-09-28T00:15:29.398296+0000","last_peered":"2023-09-28T00:15:29.398296+0000","last_clean":"2023-09-28T00:15:29.398296+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:15:29.398296+0000","last_undegraded":"2023-09-28T00:15:29.398296+0000","last_fullsized":"2023-09-28T00:15:29.398296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402636+0000","last_change":"2023-09-28T00:15:29.401695+0000","last_active":"2023-09-28T00:15:29.402636+0000","last_peered":"2023-09-28T00:15:29.402636+0000","last_clean":"2023-09-28T00:15:29.402636+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:15:29.402636+0000","last_undegraded":"2023-09-28T00:15:29.402636+0000","last_fullsized":"2023-09-28T00:15:29.402636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400097+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:15:29.400097+0000","last_peered":"2023-09-28T00:15:29.400097+0000","last_clean":"2023-09-28T00:15:29.400097+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:15:29.400097+0000","last_undegraded":"2023-09-28T00:15:29.400097+0000","last_fullsized":"2023-09-28T00:15:29.400097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391545+0000","last_change":"2023-09-28T00:15:29.386237+0000","last_active":"2023-09-28T00:15:29.391545+0000","last_peered":"2023-09-28T00:15:29.391545+0000","last_clean":"2023-09-28T00:15:29.391545+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:15:29.391545+0000","last_undegraded":"2023-09-28T00:15:29.391545+0000","last_fullsized":"2023-09-28T00:15:29.391545+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403381+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:15:29.403381+0000","last_peered":"2023-09-28T00:15:29.403381+0000","last_clean":"2023-09-28T00:15:29.403381+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:15:29.403381+0000","last_undegraded":"2023-09-28T00:15:29.403381+0000","last_fullsized":"2023-09-28T00:15:29.403381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:49:33.646923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394054+0000","last_change":"2023-09-28T00:15:29.392231+0000","last_active":"2023-09-28T00:15:29.394054+0000","last_peered":"2023-09-28T00:15:29.394054+0000","last_clean":"2023-09-28T00:15:29.394054+0000","last_became_active":"2023-09-28T00:15:29.391855+0000","last_became_peered":"2023-09-28T00:15:29.391855+0000","last_unstale":"2023-09-28T00:15:29.394054+0000","last_undegraded":"2023-09-28T00:15:29.394054+0000","last_fullsized":"2023-09-28T00:15:29.394054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.401694+0000","last_change":"2023-09-28T00:15:29.394242+0000","last_active":"2023-09-28T00:15:29.401694+0000","last_peered":"2023-09-28T00:15:29.401694+0000","last_clean":"2023-09-28T00:15:29.401694+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:15:29.401694+0000","last_undegraded":"2023-09-28T00:15:29.401694+0000","last_fullsized":"2023-09-28T00:15:29.401694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391666+0000","last_change":"2023-09-28T00:15:29.389082+0000","last_active":"2023-09-28T00:15:29.391666+0000","last_peered":"2023-09-28T00:15:29.391666+0000","last_clean":"2023-09-28T00:15:29.391666+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:15:29.391666+0000","last_undegraded":"2023-09-28T00:15:29.391666+0000","last_fullsized":"2023-09-28T00:15:29.391666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394025+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:15:29.394025+0000","last_peered":"2023-09-28T00:15:29.394025+0000","last_clean":"2023-09-28T00:15:29.394025+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:15:29.394025+0000","last_undegraded":"2023-09-28T00:15:29.394025+0000","last_fullsized":"2023-09-28T00:15:29.394025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398162+0000","last_change":"2023-09-28T00:15:29.392586+0000","last_active":"2023-09-28T00:15:29.398162+0000","last_peered":"2023-09-28T00:15:29.398162+0000","last_clean":"2023-09-28T00:15:29.398162+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:15:29.398162+0000","last_undegraded":"2023-09-28T00:15:29.398162+0000","last_fullsized":"2023-09-28T00:15:29.398162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:16:11.243076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386766+0000","last_change":"2023-09-28T00:15:29.384837+0000","last_active":"2023-09-28T00:15:29.386766+0000","last_peered":"2023-09-28T00:15:29.386766+0000","last_clean":"2023-09-28T00:15:29.386766+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:15:29.386766+0000","last_undegraded":"2023-09-28T00:15:29.386766+0000","last_fullsized":"2023-09-28T00:15:29.386766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:49:32.973094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398577+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:15:29.398577+0000","last_peered":"2023-09-28T00:15:29.398577+0000","last_clean":"2023-09-28T00:15:29.398577+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:15:29.398577+0000","last_undegraded":"2023-09-28T00:15:29.398577+0000","last_fullsized":"2023-09-28T00:15:29.398577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399602+0000","last_change":"2023-09-28T00:15:28.982899+0000","last_active":"2023-09-28T00:15:29.399602+0000","last_peered":"2023-09-28T00:15:29.399602+0000","last_clean":"2023-09-28T00:15:29.399602+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:15:29.399602+0000","last_undegraded":"2023-09-28T00:15:29.399602+0000","last_fullsized":"2023-09-28T00:15:29.399602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390553+0000","last_change":"2023-09-28T00:15:29.383398+0000","last_active":"2023-09-28T00:15:29.390553+0000","last_peered":"2023-09-28T00:15:29.390553+0000","last_clean":"2023-09-28T00:15:29.390553+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:15:29.390553+0000","last_undegraded":"2023-09-28T00:15:29.390553+0000","last_fullsized":"2023-09-28T00:15:29.390553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380346+0000","last_change":"2023-09-28T00:15:28.984308+0000","last_active":"2023-09-28T00:15:29.380346+0000","last_peered":"2023-09-28T00:15:29.380346+0000","last_clean":"2023-09-28T00:15:29.380346+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:15:29.380346+0000","last_undegraded":"2023-09-28T00:15:29.380346+0000","last_fullsized":"2023-09-28T00:15:29.380346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402446+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:15:29.402446+0000","last_peered":"2023-09-28T00:15:29.402446+0000","last_clean":"2023-09-28T00:15:29.402446+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:15:29.402446+0000","last_undegraded":"2023-09-28T00:15:29.402446+0000","last_fullsized":"2023-09-28T00:15:29.402446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375855+0000","last_change":"2023-09-28T00:15:28.986600+0000","last_active":"2023-09-28T00:15:29.375855+0000","last_peered":"2023-09-28T00:15:29.375855+0000","last_clean":"2023-09-28T00:15:29.375855+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:15:29.375855+0000","last_undegraded":"2023-09-28T00:15:29.375855+0000","last_fullsized":"2023-09-28T00:15:29.375855+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397007+0000","last_change":"2023-09-28T00:15:29.391209+0000","last_active":"2023-09-28T00:15:29.397007+0000","last_peered":"2023-09-28T00:15:29.397007+0000","last_clean":"2023-09-28T00:15:29.397007+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:15:29.397007+0000","last_undegraded":"2023-09-28T00:15:29.397007+0000","last_fullsized":"2023-09-28T00:15:29.397007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394579+0000","last_change":"2023-09-28T00:15:28.990492+0000","last_active":"2023-09-28T00:15:29.394579+0000","last_peered":"2023-09-28T00:15:29.394579+0000","last_clean":"2023-09-28T00:15:29.394579+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:15:29.394579+0000","last_undegraded":"2023-09-28T00:15:29.394579+0000","last_fullsized":"2023-09-28T00:15:29.394579+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.387663+0000","last_change":"2023-09-28T00:15:29.381022+0000","last_active":"2023-09-28T00:15:29.387663+0000","last_peered":"2023-09-28T00:15:29.387663+0000","last_clean":"2023-09-28T00:15:29.387663+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:15:29.387663+0000","last_undegraded":"2023-09-28T00:15:29.387663+0000","last_fullsized":"2023-09-28T00:15:29.387663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378888+0000","last_change":"2023-09-28T00:15:28.989043+0000","last_active":"2023-09-28T00:15:29.378888+0000","last_peered":"2023-09-28T00:15:29.378888+0000","last_clean":"2023-09-28T00:15:29.378888+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:15:29.378888+0000","last_undegraded":"2023-09-28T00:15:29.378888+0000","last_fullsized":"2023-09-28T00:15:29.378888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:31.309229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391650+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:15:29.391650+0000","last_peered":"2023-09-28T00:15:29.391650+0000","last_clean":"2023-09-28T00:15:29.391650+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:15:29.391650+0000","last_undegraded":"2023-09-28T00:15:29.391650+0000","last_fullsized":"2023-09-28T00:15:29.391650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:07:01.050188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399129+0000","last_change":"2023-09-28T00:15:28.981865+0000","last_active":"2023-09-28T00:15:29.399129+0000","last_peered":"2023-09-28T00:15:29.399129+0000","last_clean":"2023-09-28T00:15:29.399129+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:15:29.399129+0000","last_undegraded":"2023-09-28T00:15:29.399129+0000","last_fullsized":"2023-09-28T00:15:29.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397590+0000","last_change":"2023-09-28T00:15:29.389604+0000","last_active":"2023-09-28T00:15:29.397590+0000","last_peered":"2023-09-28T00:15:29.397590+0000","last_clean":"2023-09-28T00:15:29.397590+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:15:29.397590+0000","last_undegraded":"2023-09-28T00:15:29.397590+0000","last_fullsized":"2023-09-28T00:15:29.397590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.405038+0000","last_change":"2023-09-28T00:15:28.979093+0000","last_active":"2023-09-28T00:15:29.405038+0000","last_peered":"2023-09-28T00:15:29.405038+0000","last_clean":"2023-09-28T00:15:29.405038+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:15:29.405038+0000","last_undegraded":"2023-09-28T00:15:29.405038+0000","last_fullsized":"2023-09-28T00:15:29.405038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404103+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:15:29.404103+0000","last_peered":"2023-09-28T00:15:29.404103+0000","last_clean":"2023-09-28T00:15:29.404103+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:15:29.404103+0000","last_undegraded":"2023-09-28T00:15:29.404103+0000","last_fullsized":"2023-09-28T00:15:29.404103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:59:40.497846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403068+0000","last_change":"2023-09-28T00:15:28.985348+0000","last_active":"2023-09-28T00:15:29.403068+0000","last_peered":"2023-09-28T00:15:29.403068+0000","last_clean":"2023-09-28T00:15:29.403068+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:15:29.403068+0000","last_undegraded":"2023-09-28T00:15:29.403068+0000","last_fullsized":"2023-09-28T00:15:29.403068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390525+0000","last_change":"2023-09-28T00:15:29.383322+0000","last_active":"2023-09-28T00:15:29.390525+0000","last_peered":"2023-09-28T00:15:29.390525+0000","last_clean":"2023-09-28T00:15:29.390525+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:15:29.390525+0000","last_undegraded":"2023-09-28T00:15:29.390525+0000","last_fullsized":"2023-09-28T00:15:29.390525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390540+0000","last_change":"2023-09-28T00:15:28.987818+0000","last_active":"2023-09-28T00:15:29.390540+0000","last_peered":"2023-09-28T00:15:29.390540+0000","last_clean":"2023-09-28T00:15:29.390540+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:15:29.390540+0000","last_undegraded":"2023-09-28T00:15:29.390540+0000","last_fullsized":"2023-09-28T00:15:29.390540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397462+0000","last_change":"2023-09-28T00:15:29.395546+0000","last_active":"2023-09-28T00:15:29.397462+0000","last_peered":"2023-09-28T00:15:29.397462+0000","last_clean":"2023-09-28T00:15:29.397462+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:15:29.397462+0000","last_undegraded":"2023-09-28T00:15:29.397462+0000","last_fullsized":"2023-09-28T00:15:29.397462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380953+0000","last_change":"2023-09-28T00:15:28.985438+0000","last_active":"2023-09-28T00:15:29.380953+0000","last_peered":"2023-09-28T00:15:29.380953+0000","last_clean":"2023-09-28T00:15:29.380953+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:15:29.380953+0000","last_undegraded":"2023-09-28T00:15:29.380953+0000","last_fullsized":"2023-09-28T00:15:29.380953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402467+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:15:29.402467+0000","last_peered":"2023-09-28T00:15:29.402467+0000","last_clean":"2023-09-28T00:15:29.402467+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:15:29.402467+0000","last_undegraded":"2023-09-28T00:15:29.402467+0000","last_fullsized":"2023-09-28T00:15:29.402467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403755+0000","last_change":"2023-09-28T00:15:28.983275+0000","last_active":"2023-09-28T00:15:29.403755+0000","last_peered":"2023-09-28T00:15:29.403755+0000","last_clean":"2023-09-28T00:15:29.403755+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:15:29.403755+0000","last_undegraded":"2023-09-28T00:15:29.403755+0000","last_fullsized":"2023-09-28T00:15:29.403755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:10:17.162300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396946+0000","last_change":"2023-09-28T00:15:29.393952+0000","last_active":"2023-09-28T00:15:29.396946+0000","last_peered":"2023-09-28T00:15:29.396946+0000","last_clean":"2023-09-28T00:15:29.396946+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:15:29.396946+0000","last_undegraded":"2023-09-28T00:15:29.396946+0000","last_fullsized":"2023-09-28T00:15:29.396946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402648+0000","last_change":"2023-09-28T00:15:28.986391+0000","last_active":"2023-09-28T00:15:29.402648+0000","last_peered":"2023-09-28T00:15:29.402648+0000","last_clean":"2023-09-28T00:15:29.402648+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:15:29.402648+0000","last_undegraded":"2023-09-28T00:15:29.402648+0000","last_fullsized":"2023-09-28T00:15:29.402648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396755+0000","last_change":"2023-09-28T00:15:29.393474+0000","last_active":"2023-09-28T00:15:29.396755+0000","last_peered":"2023-09-28T00:15:29.396755+0000","last_clean":"2023-09-28T00:15:29.396755+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:15:29.396755+0000","last_undegraded":"2023-09-28T00:15:29.396755+0000","last_fullsized":"2023-09-28T00:15:29.396755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402943+0000","last_change":"2023-09-28T00:15:28.986082+0000","last_active":"2023-09-28T00:15:29.402943+0000","last_peered":"2023-09-28T00:15:29.402943+0000","last_clean":"2023-09-28T00:15:29.402943+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:15:29.402943+0000","last_undegraded":"2023-09-28T00:15:29.402943+0000","last_fullsized":"2023-09-28T00:15:29.402943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:16.392360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397610+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:15:29.397610+0000","last_peered":"2023-09-28T00:15:29.397610+0000","last_clean":"2023-09-28T00:15:29.397610+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:15:29.397610+0000","last_undegraded":"2023-09-28T00:15:29.397610+0000","last_fullsized":"2023-09-28T00:15:29.397610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:11:37.490848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399248+0000","last_change":"2023-09-28T00:15:28.982433+0000","last_active":"2023-09-28T00:15:29.399248+0000","last_peered":"2023-09-28T00:15:29.399248+0000","last_clean":"2023-09-28T00:15:29.399248+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:15:29.399248+0000","last_undegraded":"2023-09-28T00:15:29.399248+0000","last_fullsized":"2023-09-28T00:15:29.399248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:37:52.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395572+0000","last_change":"2023-09-28T00:15:29.388766+0000","last_active":"2023-09-28T00:15:29.395572+0000","last_peered":"2023-09-28T00:15:29.395572+0000","last_clean":"2023-09-28T00:15:29.395572+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:15:29.395572+0000","last_undegraded":"2023-09-28T00:15:29.395572+0000","last_fullsized":"2023-09-28T00:15:29.395572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.381202+0000","last_change":"2023-09-28T00:15:28.984089+0000","last_active":"2023-09-28T00:15:29.381202+0000","last_peered":"2023-09-28T00:15:29.381202+0000","last_clean":"2023-09-28T00:15:29.381202+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:15:29.381202+0000","last_undegraded":"2023-09-28T00:15:29.381202+0000","last_fullsized":"2023-09-28T00:15:29.381202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394391+0000","last_change":"2023-09-28T00:15:29.386850+0000","last_active":"2023-09-28T00:15:29.394391+0000","last_peered":"2023-09-28T00:15:29.394391+0000","last_clean":"2023-09-28T00:15:29.394391+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:15:29.394391+0000","last_undegraded":"2023-09-28T00:15:29.394391+0000","last_fullsized":"2023-09-28T00:15:29.394391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402306+0000","last_change":"2023-09-28T00:15:28.986069+0000","last_active":"2023-09-28T00:15:29.402306+0000","last_peered":"2023-09-28T00:15:29.402306+0000","last_clean":"2023-09-28T00:15:29.402306+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:15:29.402306+0000","last_undegraded":"2023-09-28T00:15:29.402306+0000","last_fullsized":"2023-09-28T00:15:29.402306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397756+0000","last_change":"2023-09-28T00:15:29.393182+0000","last_active":"2023-09-28T00:15:29.397756+0000","last_peered":"2023-09-28T00:15:29.397756+0000","last_clean":"2023-09-28T00:15:29.397756+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:15:29.397756+0000","last_undegraded":"2023-09-28T00:15:29.397756+0000","last_fullsized":"2023-09-28T00:15:29.397756+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385144+0000","last_change":"2023-09-28T00:15:28.985291+0000","last_active":"2023-09-28T00:15:29.385144+0000","last_peered":"2023-09-28T00:15:29.385144+0000","last_clean":"2023-09-28T00:15:29.385144+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:15:29.385144+0000","last_undegraded":"2023-09-28T00:15:29.385144+0000","last_fullsized":"2023-09-28T00:15:29.385144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.404083+0000","last_change":"2023-09-28T00:15:29.400083+0000","last_active":"2023-09-28T00:15:29.404083+0000","last_peered":"2023-09-28T00:15:29.404083+0000","last_clean":"2023-09-28T00:15:29.404083+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:15:29.404083+0000","last_undegraded":"2023-09-28T00:15:29.404083+0000","last_fullsized":"2023-09-28T00:15:29.404083+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385946+0000","last_change":"2023-09-28T00:15:28.980715+0000","last_active":"2023-09-28T00:15:29.385946+0000","last_peered":"2023-09-28T00:15:29.385946+0000","last_clean":"2023-09-28T00:15:29.385946+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:15:29.385946+0000","last_undegraded":"2023-09-28T00:15:29.385946+0000","last_fullsized":"2023-09-28T00:15:29.385946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400065+0000","last_change":"2023-09-28T00:15:29.397875+0000","last_active":"2023-09-28T00:15:29.400065+0000","last_peered":"2023-09-28T00:15:29.400065+0000","last_clean":"2023-09-28T00:15:29.400065+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:15:29.400065+0000","last_undegraded":"2023-09-28T00:15:29.400065+0000","last_fullsized":"2023-09-28T00:15:29.400065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:35:06.112174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375411+0000","last_change":"2023-09-28T00:15:28.986410+0000","last_active":"2023-09-28T00:15:29.375411+0000","last_peered":"2023-09-28T00:15:29.375411+0000","last_clean":"2023-09-28T00:15:29.375411+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:15:29.375411+0000","last_undegraded":"2023-09-28T00:15:29.375411+0000","last_fullsized":"2023-09-28T00:15:29.375411+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398187+0000","last_change":"2023-09-28T00:15:29.392748+0000","last_active":"2023-09-28T00:15:29.398187+0000","last_peered":"2023-09-28T00:15:29.398187+0000","last_clean":"2023-09-28T00:15:29.398187+0000","last_became_active":"2023-09-28T00:15:29.392336+0000","last_became_peered":"2023-09-28T00:15:29.392336+0000","last_unstale":"2023-09-28T00:15:29.398187+0000","last_undegraded":"2023-09-28T00:15:29.398187+0000","last_fullsized":"2023-09-28T00:15:29.398187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:55:08.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380356+0000","last_change":"2023-09-28T00:15:24.193273+0000","last_active":"2023-09-28T00:15:29.380356+0000","last_peered":"2023-09-28T00:15:29.380356+0000","last_clean":"2023-09-28T00:15:29.380356+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:15:29.380356+0000","last_undegraded":"2023-09-28T00:15:29.380356+0000","last_fullsized":"2023-09-28T00:15:29.380356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:55:44.401134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379326+0000","last_change":"2023-09-28T00:15:28.986194+0000","last_active":"2023-09-28T00:15:29.379326+0000","last_peered":"2023-09-28T00:15:29.379326+0000","last_clean":"2023-09-28T00:15:29.379326+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:15:29.379326+0000","last_undegraded":"2023-09-28T00:15:29.379326+0000","last_fullsized":"2023-09-28T00:15:29.379326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390889+0000","last_change":"2023-09-28T00:15:29.388604+0000","last_active":"2023-09-28T00:15:29.390889+0000","last_peered":"2023-09-28T00:15:29.390889+0000","last_clean":"2023-09-28T00:15:29.390889+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:15:29.390889+0000","last_undegraded":"2023-09-28T00:15:29.390889+0000","last_fullsized":"2023-09-28T00:15:29.390889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378226+0000","last_change":"2023-09-28T00:15:23.950475+0000","last_active":"2023-09-28T00:15:29.378226+0000","last_peered":"2023-09-28T00:15:29.378226+0000","last_clean":"2023-09-28T00:15:29.378226+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:15:29.378226+0000","last_undegraded":"2023-09-28T00:15:29.378226+0000","last_fullsized":"2023-09-28T00:15:29.378226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386282+0000","last_change":"2023-09-28T00:15:28.984604+0000","last_active":"2023-09-28T00:15:29.386282+0000","last_peered":"2023-09-28T00:15:29.386282+0000","last_clean":"2023-09-28T00:15:29.386282+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:15:29.386282+0000","last_undegraded":"2023-09-28T00:15:29.386282+0000","last_fullsized":"2023-09-28T00:15:29.386282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398171+0000","last_change":"2023-09-28T00:15:29.392616+0000","last_active":"2023-09-28T00:15:29.398171+0000","last_peered":"2023-09-28T00:15:29.398171+0000","last_clean":"2023-09-28T00:15:29.398171+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:15:29.398171+0000","last_undegraded":"2023-09-28T00:15:29.398171+0000","last_fullsized":"2023-09-28T00:15:29.398171+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:20:56.060002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379003+0000","last_change":"2023-09-28T00:15:24.193731+0000","last_active":"2023-09-28T00:15:29.379003+0000","last_peered":"2023-09-28T00:15:29.379003+0000","last_clean":"2023-09-28T00:15:29.379003+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:15:29.379003+0000","last_undegraded":"2023-09-28T00:15:29.379003+0000","last_fullsized":"2023-09-28T00:15:29.379003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:10:07.451099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.378537+0000","last_change":"2023-09-28T00:15:28.980294+0000","last_active":"2023-09-28T00:15:29.378537+0000","last_peered":"2023-09-28T00:15:29.378537+0000","last_clean":"2023-09-28T00:15:29.378537+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:15:29.378537+0000","last_undegraded":"2023-09-28T00:15:29.378537+0000","last_fullsized":"2023-09-28T00:15:29.378537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:42:26.049017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390883+0000","last_change":"2023-09-28T00:15:29.388008+0000","last_active":"2023-09-28T00:15:29.390883+0000","last_peered":"2023-09-28T00:15:29.390883+0000","last_clean":"2023-09-28T00:15:29.390883+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:15:29.390883+0000","last_undegraded":"2023-09-28T00:15:29.390883+0000","last_fullsized":"2023-09-28T00:15:29.390883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.377855+0000","last_change":"2023-09-28T00:15:23.950457+0000","last_active":"2023-09-28T00:15:29.377855+0000","last_peered":"2023-09-28T00:15:29.377855+0000","last_clean":"2023-09-28T00:15:29.377855+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:15:29.377855+0000","last_undegraded":"2023-09-28T00:15:29.377855+0000","last_fullsized":"2023-09-28T00:15:29.377855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380256+0000","last_change":"2023-09-28T00:15:16.995081+0000","last_active":"2023-09-28T00:15:29.380256+0000","last_peered":"2023-09-28T00:15:29.380256+0000","last_clean":"2023-09-28T00:15:29.380256+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:15:29.380256+0000","last_undegraded":"2023-09-28T00:15:29.380256+0000","last_fullsized":"2023-09-28T00:15:29.380256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_clean_scrub_stamp":"2023-09-28T00:15:15.867916+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:37:49.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.375538+0000","last_change":"2023-09-28T00:15:28.985016+0000","last_active":"2023-09-28T00:15:29.375538+0000","last_peered":"2023-09-28T00:15:29.375538+0000","last_clean":"2023-09-28T00:15:29.375538+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:15:29.375538+0000","last_undegraded":"2023-09-28T00:15:29.375538+0000","last_fullsized":"2023-09-28T00:15:29.375538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403095+0000","last_change":"2023-09-28T00:15:29.401863+0000","last_active":"2023-09-28T00:15:29.403095+0000","last_peered":"2023-09-28T00:15:29.403095+0000","last_clean":"2023-09-28T00:15:29.403095+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:15:29.403095+0000","last_undegraded":"2023-09-28T00:15:29.403095+0000","last_fullsized":"2023-09-28T00:15:29.403095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:17.400054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380675+0000","last_change":"2023-09-28T00:15:23.946737+0000","last_active":"2023-09-28T00:15:29.380675+0000","last_peered":"2023-09-28T00:15:29.380675+0000","last_clean":"2023-09-28T00:15:29.380675+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:15:29.380675+0000","last_undegraded":"2023-09-28T00:15:29.380675+0000","last_fullsized":"2023-09-28T00:15:29.380675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.386570+0000","last_change":"2023-09-28T00:15:28.986464+0000","last_active":"2023-09-28T00:15:29.386570+0000","last_peered":"2023-09-28T00:15:29.386570+0000","last_clean":"2023-09-28T00:15:29.386570+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:15:29.386570+0000","last_undegraded":"2023-09-28T00:15:29.386570+0000","last_fullsized":"2023-09-28T00:15:29.386570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398876+0000","last_change":"2023-09-28T00:15:29.390313+0000","last_active":"2023-09-28T00:15:29.398876+0000","last_peered":"2023-09-28T00:15:29.398876+0000","last_clean":"2023-09-28T00:15:29.398876+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:15:29.398876+0000","last_undegraded":"2023-09-28T00:15:29.398876+0000","last_fullsized":"2023-09-28T00:15:29.398876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379277+0000","last_change":"2023-09-28T00:15:24.193260+0000","last_active":"2023-09-28T00:15:29.379277+0000","last_peered":"2023-09-28T00:15:29.379277+0000","last_clean":"2023-09-28T00:15:29.379277+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:15:29.379277+0000","last_undegraded":"2023-09-28T00:15:29.379277+0000","last_fullsized":"2023-09-28T00:15:29.379277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380464+0000","last_change":"2023-09-28T00:15:28.979725+0000","last_active":"2023-09-28T00:15:29.380464+0000","last_peered":"2023-09-28T00:15:29.380464+0000","last_clean":"2023-09-28T00:15:29.380464+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:15:29.380464+0000","last_undegraded":"2023-09-28T00:15:29.380464+0000","last_fullsized":"2023-09-28T00:15:29.380464+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:29:55.484588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402412+0000","last_change":"2023-09-28T00:15:29.398984+0000","last_active":"2023-09-28T00:15:29.402412+0000","last_peered":"2023-09-28T00:15:29.402412+0000","last_clean":"2023-09-28T00:15:29.402412+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:15:29.402412+0000","last_undegraded":"2023-09-28T00:15:29.402412+0000","last_fullsized":"2023-09-28T00:15:29.402412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395338+0000","last_change":"2023-09-28T00:15:28.989236+0000","last_active":"2023-09-28T00:15:29.395338+0000","last_peered":"2023-09-28T00:15:29.395338+0000","last_clean":"2023-09-28T00:15:29.395338+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:15:29.395338+0000","last_undegraded":"2023-09-28T00:15:29.395338+0000","last_fullsized":"2023-09-28T00:15:29.395338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:03:35.531464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380630+0000","last_change":"2023-09-28T00:15:23.949425+0000","last_active":"2023-09-28T00:15:29.380630+0000","last_peered":"2023-09-28T00:15:29.380630+0000","last_clean":"2023-09-28T00:15:29.380630+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:15:29.380630+0000","last_undegraded":"2023-09-28T00:15:29.380630+0000","last_fullsized":"2023-09-28T00:15:29.380630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:59:04.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391469+0000","last_change":"2023-09-28T00:15:29.386508+0000","last_active":"2023-09-28T00:15:29.391469+0000","last_peered":"2023-09-28T00:15:29.391469+0000","last_clean":"2023-09-28T00:15:29.391469+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:15:29.391469+0000","last_undegraded":"2023-09-28T00:15:29.391469+0000","last_fullsized":"2023-09-28T00:15:29.391469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:16:02.495050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385234+0000","last_change":"2023-09-28T00:15:23.949692+0000","last_active":"2023-09-28T00:15:29.385234+0000","last_peered":"2023-09-28T00:15:29.385234+0000","last_clean":"2023-09-28T00:15:29.385234+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:15:29.385234+0000","last_undegraded":"2023-09-28T00:15:29.385234+0000","last_fullsized":"2023-09-28T00:15:29.385234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:48:11.275095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778335+0000","last_change":"2023-09-28T00:15:28.988077+0000","last_active":"2023-09-28T00:15:30.778335+0000","last_peered":"2023-09-28T00:15:30.778335+0000","last_clean":"2023-09-28T00:15:30.778335+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:15:30.778335+0000","last_undegraded":"2023-09-28T00:15:30.778335+0000","last_fullsized":"2023-09-28T00:15:30.778335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399373+0000","last_change":"2023-09-28T00:15:29.398170+0000","last_active":"2023-09-28T00:15:29.399373+0000","last_peered":"2023-09-28T00:15:29.399373+0000","last_clean":"2023-09-28T00:15:29.399373+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:15:29.399373+0000","last_undegraded":"2023-09-28T00:15:29.399373+0000","last_fullsized":"2023-09-28T00:15:29.399373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:30:23.382889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402252+0000","last_change":"2023-09-28T00:15:28.987224+0000","last_active":"2023-09-28T00:15:29.402252+0000","last_peered":"2023-09-28T00:15:29.402252+0000","last_clean":"2023-09-28T00:15:29.402252+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:15:29.402252+0000","last_undegraded":"2023-09-28T00:15:29.402252+0000","last_fullsized":"2023-09-28T00:15:29.402252+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:05.278468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391371+0000","last_change":"2023-09-28T00:15:29.383759+0000","last_active":"2023-09-28T00:15:29.391371+0000","last_peered":"2023-09-28T00:15:29.391371+0000","last_clean":"2023-09-28T00:15:29.391371+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:15:29.391371+0000","last_undegraded":"2023-09-28T00:15:29.391371+0000","last_fullsized":"2023-09-28T00:15:29.391371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:39:06.286162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402275+0000","last_change":"2023-09-28T00:15:28.987633+0000","last_active":"2023-09-28T00:15:29.402275+0000","last_peered":"2023-09-28T00:15:29.402275+0000","last_clean":"2023-09-28T00:15:29.402275+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:15:29.402275+0000","last_undegraded":"2023-09-28T00:15:29.402275+0000","last_fullsized":"2023-09-28T00:15:29.402275+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.398131+0000","last_change":"2023-09-28T00:15:29.392897+0000","last_active":"2023-09-28T00:15:29.398131+0000","last_peered":"2023-09-28T00:15:29.398131+0000","last_clean":"2023-09-28T00:15:29.398131+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:15:29.398131+0000","last_undegraded":"2023-09-28T00:15:29.398131+0000","last_fullsized":"2023-09-28T00:15:29.398131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:40:16.899673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403684+0000","last_change":"2023-09-28T00:15:28.987962+0000","last_active":"2023-09-28T00:15:29.403684+0000","last_peered":"2023-09-28T00:15:29.403684+0000","last_clean":"2023-09-28T00:15:29.403684+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:15:29.403684+0000","last_undegraded":"2023-09-28T00:15:29.403684+0000","last_fullsized":"2023-09-28T00:15:29.403684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399076+0000","last_change":"2023-09-28T00:15:29.394598+0000","last_active":"2023-09-28T00:15:29.399076+0000","last_peered":"2023-09-28T00:15:29.399076+0000","last_clean":"2023-09-28T00:15:29.399076+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:15:29.399076+0000","last_undegraded":"2023-09-28T00:15:29.399076+0000","last_fullsized":"2023-09-28T00:15:29.399076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:43:51.005844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.396285+0000","last_change":"2023-09-28T00:15:28.983686+0000","last_active":"2023-09-28T00:15:29.396285+0000","last_peered":"2023-09-28T00:15:29.396285+0000","last_clean":"2023-09-28T00:15:29.396285+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:15:29.396285+0000","last_undegraded":"2023-09-28T00:15:29.396285+0000","last_fullsized":"2023-09-28T00:15:29.396285+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:47:37.454423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391633+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:15:29.391633+0000","last_peered":"2023-09-28T00:15:29.391633+0000","last_clean":"2023-09-28T00:15:29.391633+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:15:29.391633+0000","last_undegraded":"2023-09-28T00:15:29.391633+0000","last_fullsized":"2023-09-28T00:15:29.391633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402519+0000","last_change":"2023-09-28T00:15:28.985280+0000","last_active":"2023-09-28T00:15:29.402519+0000","last_peered":"2023-09-28T00:15:29.402519+0000","last_clean":"2023-09-28T00:15:29.402519+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:15:29.402519+0000","last_undegraded":"2023-09-28T00:15:29.402519+0000","last_fullsized":"2023-09-28T00:15:29.402519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400030+0000","last_change":"2023-09-28T00:15:29.398360+0000","last_active":"2023-09-28T00:15:29.400030+0000","last_peered":"2023-09-28T00:15:29.400030+0000","last_clean":"2023-09-28T00:15:29.400030+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:15:29.400030+0000","last_undegraded":"2023-09-28T00:15:29.400030+0000","last_fullsized":"2023-09-28T00:15:29.400030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:58:13.878285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400854+0000","last_change":"2023-09-28T00:15:29.395080+0000","last_active":"2023-09-28T00:15:29.400854+0000","last_peered":"2023-09-28T00:15:29.400854+0000","last_clean":"2023-09-28T00:15:29.400854+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:15:29.400854+0000","last_undegraded":"2023-09-28T00:15:29.400854+0000","last_fullsized":"2023-09-28T00:15:29.400854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:39.792299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391615+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:15:29.391615+0000","last_peered":"2023-09-28T00:15:29.391615+0000","last_clean":"2023-09-28T00:15:29.391615+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:15:29.391615+0000","last_undegraded":"2023-09-28T00:15:29.391615+0000","last_fullsized":"2023-09-28T00:15:29.391615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403283+0000","last_change":"2023-09-28T00:15:29.399203+0000","last_active":"2023-09-28T00:15:29.403283+0000","last_peered":"2023-09-28T00:15:29.403283+0000","last_clean":"2023-09-28T00:15:29.403283+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:15:29.403283+0000","last_undegraded":"2023-09-28T00:15:29.403283+0000","last_fullsized":"2023-09-28T00:15:29.403283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:47:48.079491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.391392+0000","last_change":"2023-09-28T00:15:29.388644+0000","last_active":"2023-09-28T00:15:29.391392+0000","last_peered":"2023-09-28T00:15:29.391392+0000","last_clean":"2023-09-28T00:15:29.391392+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:15:29.391392+0000","last_undegraded":"2023-09-28T00:15:29.391392+0000","last_fullsized":"2023-09-28T00:15:29.391392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:40:13.587285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390790+0000","last_change":"2023-09-28T00:15:29.388432+0000","last_active":"2023-09-28T00:15:29.390790+0000","last_peered":"2023-09-28T00:15:29.390790+0000","last_clean":"2023-09-28T00:15:29.390790+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:15:29.390790+0000","last_undegraded":"2023-09-28T00:15:29.390790+0000","last_fullsized":"2023-09-28T00:15:29.390790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:43:23.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8004,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363836,"statfs":{"total":96636764160,"available":96628568064,"internally_reserved":0,"allocated":258048,"data_stored":93762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9092,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362748,"statfs":{"total":96636764160,"available":96627453952,"internally_reserved":0,"allocated":847872,"data_stored":684060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9116,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362724,"statfs":{"total":96636764160,"available":96627429376,"internally_reserved":0,"allocated":872448,"data_stored":685258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7932,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363908,"statfs":{"total":96636764160,"available":96628641792,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":93228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":270336,"data_stored":94730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:15:46.133 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:15:46.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.286+0000 7f09c25b1700 1 Processor -- start 2023-09-28T00:15:46.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.286+0000 7f09c25b1700 1 -- start start 2023-09-28T00:15:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.286+0000 7f09c25b1700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09bc0add70 0x7f09bc0ae190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.286+0000 7f09c25b1700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc1580d0 con 0x7f09bc0b4060 2023-09-28T00:15:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.286+0000 7f09c25b1700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc0ae6d0 con 0x7f09bc157570 2023-09-28T00:15:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.286+0000 7f09c25b1700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc158c70 con 0x7f09bc0add70 2023-09-28T00:15:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09c0b4e700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f09bc0add70 0x7f09bc0ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:46.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09b3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f09bc0b4060 0x7f09bc158560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49256/0 (socket says 172.21.15.26:49256) 2023-09-28T00:15:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09b3fff700 1 -- 172.21.15.26:0/1633050631 learned_addr learned my addr 172.21.15.26:0/1633050631 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09c0b4e700 1 -- 172.21.15.26:0/1633050631 >> v1:172.21.15.190:6789/0 conn(0x7f09bc157570 legacy=0x7f09bc15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09c0b4e700 1 -- 172.21.15.26:0/1633050631 >> v1:172.21.15.26:6789/0 conn(0x7f09bc0b4060 legacy=0x7f09bc158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09c0b4e700 1 -- 172.21.15.26:0/1633050631 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc15ba40 con 0x7f09bc0add70 2023-09-28T00:15:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09bb7fe700 1 -- 172.21.15.26:0/1633050631 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141494448 0 0) 0x7f09bc1580d0 con 0x7f09bc0b4060 2023-09-28T00:15:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09c0b4e700 1 --2- 172.21.15.26:0/1633050631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 0x7f09bc0ae190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009e60 tx=0x7f09b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fe7e690e41f21d server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:46.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09bb7fe700 1 -- 172.21.15.26:0/1633050631 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400e070 con 0x7f09bc0add70 2023-09-28T00:15:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09bb7fe700 1 -- 172.21.15.26:0/1633050631 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b400bc30 con 0x7f09bc0add70 2023-09-28T00:15:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.287+0000 7f09bb7fe700 1 -- 172.21.15.26:0/1633050631 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4012430 con 0x7f09bc0add70 2023-09-28T00:15:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.288+0000 7f09c25b1700 1 -- 172.21.15.26:0/1633050631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 msgr2=0x7f09bc0ae190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.288+0000 7f09c25b1700 1 --2- 172.21.15.26:0/1633050631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 0x7f09bc0ae190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009e60 tx=0x7f09b4009780 comp rx=0 tx=0).stop 2023-09-28T00:15:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.288+0000 7f09c25b1700 1 -- 172.21.15.26:0/1633050631 shutdown_connections 2023-09-28T00:15:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.288+0000 7f09c25b1700 1 --2- 172.21.15.26:0/1633050631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 0x7f09bc0ae190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.288+0000 7f09c25b1700 1 -- 172.21.15.26:0/1633050631 >> 172.21.15.26:0/1633050631 conn(0x7f09bc067630 msgr2=0x7f09bc067a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:46.291 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.288+0000 7f09c25b1700 1 -- 172.21.15.26:0/1633050631 shutdown_connections 2023-09-28T00:15:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.288+0000 7f09c25b1700 1 -- 172.21.15.26:0/1633050631 wait complete. 2023-09-28T00:15:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.289+0000 7f09c25b1700 1 Processor -- start 2023-09-28T00:15:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.289+0000 7f09c25b1700 1 -- start start 2023-09-28T00:15:46.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09c25b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 0x7f09bc1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09c25b1700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09bc0b4060 0x7f09bc159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09c25b1700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09bc157570 0x7f09bc0c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09c25b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc15a100 con 0x7f09bc0add70 2023-09-28T00:15:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09c25b1700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc15a3e0 con 0x7f09bc157570 2023-09-28T00:15:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09c25b1700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc15a6c0 con 0x7f09bc0b4060 2023-09-28T00:15:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 0x7f09bc1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09bbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 0x7f09bc1559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40134/0 (socket says 172.21.15.26:40134) 2023-09-28T00:15:46.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09bbfff700 1 -- 172.21.15.26:0/4089662235 learned_addr learned my addr 172.21.15.26:0/4089662235 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09b3fff700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09bc0b4060 0x7f09bc159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09c0b4e700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09bc157570 0x7f09bc0c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09bbfff700 1 -- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09bc0b4060 msgr2=0x7f09bc159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09bbfff700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09bc0b4060 0x7f09bc159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09bbfff700 1 -- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09bc157570 msgr2=0x7f09bc0c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09bbfff700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09bc157570 0x7f09bc0c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09bbfff700 1 -- 172.21.15.26:0/4089662235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b4009a20 con 0x7f09bc0add70 2023-09-28T00:15:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09bbfff700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 0x7f09bc1559b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00b5e0 tx=0x7f09ac009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09b8ff9700 1 -- 172.21.15.26:0/4089662235 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac00f510 con 0x7f09bc0add70 2023-09-28T00:15:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09b8ff9700 1 -- 172.21.15.26:0/4089662235 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac00f670 con 0x7f09bc0add70 2023-09-28T00:15:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc169f70 con 0x7f09bc0add70 2023-09-28T00:15:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09b8ff9700 1 -- 172.21.15.26:0/4089662235 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac00fa30 con 0x7f09bc0add70 2023-09-28T00:15:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.290+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc159db0 con 0x7f09bc0add70 2023-09-28T00:15:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.291+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc064050 con 0x7f09bc0add70 2023-09-28T00:15:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.292+0000 7f09b8ff9700 1 -- 172.21.15.26:0/4089662235 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f09ac01a400 con 0x7f09bc0add70 2023-09-28T00:15:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.292+0000 7f09b8ff9700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f099c067330 0x7f099c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.292+0000 7f09b8ff9700 1 -- 172.21.15.26:0/4089662235 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f09ac0846d0 con 0x7f09bc0add70 2023-09-28T00:15:46.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.293+0000 7f09b3fff700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f099c067330 0x7f099c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:46.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.293+0000 7f09b3fff700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f099c067330 0x7f099c0697e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ad520 tx=0x7f09a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:46.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.297+0000 7f09b8ff9700 1 -- 172.21.15.26:0/4089662235 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f09ac051650 con 0x7f09bc0add70 2023-09-28T00:15:46.493 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.492+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09bc0cdf50 con 0x7f09bc0add70 2023-09-28T00:15:46.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.493+0000 7f09b8ff9700 1 -- 172.21.15.26:0/4089662235 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16866 (secure 0 0 0) 0x7f09ac054c70 con 0x7f09bc0add70 2023-09-28T00:15:46.494 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:46.494 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:15:30.373905+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:15:46.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f099c067330 msgr2=0x7f099c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:46.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f099c067330 0x7f099c0697e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ad520 tx=0x7f09a4009040 comp rx=0 tx=0).stop 2023-09-28T00:15:46.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 msgr2=0x7f09bc1559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:46.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 0x7f09bc1559b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00b5e0 tx=0x7f09ac009120 comp rx=0 tx=0).stop 2023-09-28T00:15:46.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 shutdown_connections 2023-09-28T00:15:46.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f099c067330 0x7f099c0697e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f09bc157570 0x7f09bc0c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f09bc0add70 0x7f09bc1559b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 --2- 172.21.15.26:0/4089662235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f09bc0b4060 0x7f09bc159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:46.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 >> 172.21.15.26:0/4089662235 conn(0x7f09bc067630 msgr2=0x7f09bc06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:46.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 shutdown_connections 2023-09-28T00:15:46.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:46.495+0000 7f09c25b1700 1 -- 172.21.15.26:0/4089662235 wait complete. 2023-09-28T00:15:47.509 INFO:tasks.ceph:Scrubbing osd.0 2023-09-28T00:15:47.510 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:15:47.645 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.644+0000 7f5f1df33700 1 Processor -- start 2023-09-28T00:15:47.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.644+0000 7f5f1df33700 1 -- start start 2023-09-28T00:15:47.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f1df33700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 0x7f5f180ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f1df33700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5f180cf800 0x7f5f180b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f1df33700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f180cbed0 con 0x7f5f180d0f00 2023-09-28T00:15:47.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f1df33700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f18159d40 con 0x7f5f180cf800 2023-09-28T00:15:47.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f1df33700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180cc750 con 0x7f5f180b55b0 2023-09-28T00:15:47.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f17fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5f180d0f00 0x7f5f180ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49262/0 (socket says 172.21.15.26:49262) 2023-09-28T00:15:47.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f17fff700 1 -- 172.21.15.26:0/143650794 learned_addr learned my addr 172.21.15.26:0/143650794 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:47.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f16ffd700 1 --2- 172.21.15.26:0/143650794 >> v2:172.21.15.190:3300/0 conn(0x7f5f180cf800 0x7f5f180b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.683 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f177fe700 1 --2- 172.21.15.26:0/143650794 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 0x7f5f180ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f167fc700 1 -- 172.21.15.26:0/143650794 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936347107 0 0) 0x7f5f180cbed0 con 0x7f5f180d0f00 2023-09-28T00:15:47.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.645+0000 7f5f167fc700 1 -- 172.21.15.26:0/143650794 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f00003570 con 0x7f5f180d0f00 2023-09-28T00:15:47.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f177fe700 1 -- 172.21.15.26:0/143650794 >> v2:172.21.15.190:3300/0 conn(0x7f5f180cf800 msgr2=0x7f5f180b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:47.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f177fe700 1 --2- 172.21.15.26:0/143650794 >> v2:172.21.15.190:3300/0 conn(0x7f5f180cf800 0x7f5f180b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f177fe700 1 -- 172.21.15.26:0/143650794 >> v1:172.21.15.26:6789/0 conn(0x7f5f180d0f00 legacy=0x7f5f180ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f177fe700 1 -- 172.21.15.26:0/143650794 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f180b5ec0 con 0x7f5f180b55b0 2023-09-28T00:15:47.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f16ffd700 1 --2- 172.21.15.26:0/143650794 >> v2:172.21.15.190:3300/0 conn(0x7f5f180cf800 0x7f5f180b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:47.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f177fe700 1 --2- 172.21.15.26:0/143650794 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 0x7f5f180ccbe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f080098d0 tx=0x7f5f08009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4694b79e81e85e server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:47.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f167fc700 1 -- 172.21.15.26:0/143650794 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08005c10 con 0x7f5f180b55b0 2023-09-28T00:15:47.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f167fc700 1 -- 172.21.15.26:0/143650794 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f08005d70 con 0x7f5f180b55b0 2023-09-28T00:15:47.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f167fc700 1 -- 172.21.15.26:0/143650794 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f08006280 con 0x7f5f180b55b0 2023-09-28T00:15:47.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f1df33700 1 -- 172.21.15.26:0/143650794 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 msgr2=0x7f5f180ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f1df33700 1 --2- 172.21.15.26:0/143650794 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 0x7f5f180ccbe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5f080098d0 tx=0x7f5f08009120 comp rx=0 tx=0).stop 2023-09-28T00:15:47.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f1df33700 1 -- 172.21.15.26:0/143650794 shutdown_connections 2023-09-28T00:15:47.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f1df33700 1 --2- 172.21.15.26:0/143650794 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 0x7f5f180ccbe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f1df33700 1 --2- 172.21.15.26:0/143650794 >> v2:172.21.15.190:3300/0 conn(0x7f5f180cf800 0x7f5f180b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.646+0000 7f5f1df33700 1 -- 172.21.15.26:0/143650794 >> 172.21.15.26:0/143650794 conn(0x7f5f1808a050 msgr2=0x7f5f18099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:47.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.647+0000 7f5f1df33700 1 -- 172.21.15.26:0/143650794 shutdown_connections 2023-09-28T00:15:47.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.647+0000 7f5f1df33700 1 -- 172.21.15.26:0/143650794 wait complete. 2023-09-28T00:15:47.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.648+0000 7f5f1df33700 1 Processor -- start 2023-09-28T00:15:47.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.648+0000 7f5f1df33700 1 -- start start 2023-09-28T00:15:47.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f1df33700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 0x7f5f181572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f1df33700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f180cf800 0x7f5f1806a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.686 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f1df33700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f180d0f00 0x7f5f180c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f1df33700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f18069240 con 0x7f5f180d0f00 2023-09-28T00:15:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f1df33700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f181577e0 con 0x7f5f180cf800 2023-09-28T00:15:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f1df33700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180681e0 con 0x7f5f180b55b0 2023-09-28T00:15:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f180d0f00 0x7f5f180c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f180d0f00 0x7f5f180c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40136/0 (socket says 172.21.15.26:40136) 2023-09-28T00:15:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f17fff700 1 -- 172.21.15.26:0/2088925429 learned_addr learned my addr 172.21.15.26:0/2088925429 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f177fe700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 0x7f5f181572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f16ffd700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f180cf800 0x7f5f1806a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f17fff700 1 -- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 msgr2=0x7f5f181572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f17fff700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5f180b55b0 0x7f5f181572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f17fff700 1 -- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f180cf800 msgr2=0x7f5f1806a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f17fff700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5f180cf800 0x7f5f1806a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f17fff700 1 -- 172.21.15.26:0/2088925429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c009420 con 0x7f5f180d0f00 2023-09-28T00:15:47.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f17fff700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f180d0f00 0x7f5f180c90b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f10001460 tx=0x7f5f10001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:47.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5eff7fe700 1 -- 172.21.15.26:0/2088925429 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1000a870 con 0x7f5f180d0f00 2023-09-28T00:15:47.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5eff7fe700 1 -- 172.21.15.26:0/2088925429 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1000a9d0 con 0x7f5f180d0f00 2023-09-28T00:15:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f080093c0 con 0x7f5f180d0f00 2023-09-28T00:15:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.649+0000 7f5eff7fe700 1 -- 172.21.15.26:0/2088925429 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1000ad50 con 0x7f5f180d0f00 2023-09-28T00:15:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.650+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f18068a40 con 0x7f5f180d0f00 2023-09-28T00:15:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.650+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5f180717c0 con 0x7f5f180d0f00 2023-09-28T00:15:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.651+0000 7f5eff7fe700 1 -- 172.21.15.26:0/2088925429 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5f10007300 con 0x7f5f180d0f00 2023-09-28T00:15:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.651+0000 7f5eff7fe700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5f04067360 0x7f5f04069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.651+0000 7f5eff7fe700 1 -- 172.21.15.26:0/2088925429 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f100858e0 con 0x7f5f180d0f00 2023-09-28T00:15:47.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.651+0000 7f5eff7fe700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f5f0406fc10 0x7f5f04072020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.651+0000 7f5eff7fe700 1 -- 172.21.15.26:0/2088925429 --> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5f040726d0 con 0x7f5f0406fc10 2023-09-28T00:15:47.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.651+0000 7f5eff7fe700 1 -- 172.21.15.26:0/2088925429 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f10085cb0 con 0x7f5f180d0f00 2023-09-28T00:15:47.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.652+0000 7f5f16ffd700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f5f0406fc10 0x7f5f04072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.652+0000 7f5f177fe700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5f04067360 0x7f5f04069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.652+0000 7f5f16ffd700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f5f0406fc10 0x7f5f04072020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:47.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.652+0000 7f5f177fe700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5f04067360 0x7f5f04069810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f080098d0 tx=0x7f5f08016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:47.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.653+0000 7f5eff7fe700 1 -- 172.21.15.26:0/2088925429 <== osd.0 v2:172.21.15.26:6816/90241 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5f040726d0 con 0x7f5f0406fc10 2023-09-28T00:15:47.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.666+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 --> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5f180cffe0 con 0x7f5f0406fc10 2023-09-28T00:15:47.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5eff7fe700 1 -- 172.21.15.26:0/2088925429 <== osd.0 v2:172.21.15.26:6816/90241 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5f180cffe0 con 0x7f5f0406fc10 2023-09-28T00:15:47.691 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-09-28T00:15:47.691 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:15:47.691 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-09-28T00:15:47.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f5f0406fc10 msgr2=0x7f5f04072020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.26:6816/90241,v1:172.21.15.26:6817/90241] conn(0x7f5f0406fc10 0x7f5f04072020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5f04067360 msgr2=0x7f5f04069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5f04067360 0x7f5f04069810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f080098d0 tx=0x7f5f08016000 comp rx=0 tx=0).stop 2023-09-28T00:15:47.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f180d0f00 msgr2=0x7f5f180c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 --2- 172.21.15.26:0/2088925429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f180d0f00 0x7f5f180c90b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5f10001460 tx=0x7f5f10001a40 comp rx=0 tx=0).stop 2023-09-28T00:15:47.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f17fff700 1 -- 172.21.15.26:0/2088925429 reap_dead start 2023-09-28T00:15:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 shutdown_connections 2023-09-28T00:15:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 >> 172.21.15.26:0/2088925429 conn(0x7f5f1808a050 msgr2=0x7f5f18159080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 shutdown_connections 2023-09-28T00:15:47.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.667+0000 7f5f1df33700 1 -- 172.21.15.26:0/2088925429 wait complete. 2023-09-28T00:15:47.694 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-28T00:15:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.813+0000 7ff0301a7700 1 Processor -- start 2023-09-28T00:15:47.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.813+0000 7ff0301a7700 1 -- start start 2023-09-28T00:15:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff0301a7700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff028159500 0x7ff0281598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff0301a7700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0280b3fd0 0x7ff02815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff0301a7700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02815dd20 con 0x7ff02815d8e0 2023-09-28T00:15:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff0301a7700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0280b1110 con 0x7ff0280b3fd0 2023-09-28T00:15:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff0301a7700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0280b13b0 con 0x7ff028159500 2023-09-28T00:15:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02d742700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0280b3fd0 0x7ff02815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02d742700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff0280b3fd0 0x7ff02815d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40140/0 (socket says 172.21.15.26:40140) 2023-09-28T00:15:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02d742700 1 -- 172.21.15.26:0/2346088813 learned_addr learned my addr 172.21.15.26:0/2346088813 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02df43700 1 --2- 172.21.15.26:0/2346088813 >> v2:172.21.15.190:3300/0 conn(0x7ff028159500 0x7ff0281598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02d742700 1 -- 172.21.15.26:0/2346088813 >> v2:172.21.15.190:3300/0 conn(0x7ff028159500 msgr2=0x7ff0281598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02d742700 1 --2- 172.21.15.26:0/2346088813 >> v2:172.21.15.190:3300/0 conn(0x7ff028159500 0x7ff0281598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02d742700 1 -- 172.21.15.26:0/2346088813 >> v1:172.21.15.190:6789/0 conn(0x7ff02815d8e0 legacy=0x7ff0280cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02d742700 1 -- 172.21.15.26:0/2346088813 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280b1690 con 0x7ff0280b3fd0 2023-09-28T00:15:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02df43700 1 --2- 172.21.15.26:0/2346088813 >> v2:172.21.15.190:3300/0 conn(0x7ff028159500 0x7ff0281598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.814+0000 7ff02d742700 1 --2- 172.21.15.26:0/2346088813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0280b3fd0 0x7ff02815d3a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff028063e00 tx=0x7ff01c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8d530d3e5dbd8b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff02cf41700 1 -- 172.21.15.26:0/2346088813 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00b820 con 0x7ff0280b3fd0 2023-09-28T00:15:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff02cf41700 1 -- 172.21.15.26:0/2346088813 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c00b980 con 0x7ff0280b3fd0 2023-09-28T00:15:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff02cf41700 1 -- 172.21.15.26:0/2346088813 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00bd20 con 0x7ff0280b3fd0 2023-09-28T00:15:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff0301a7700 1 -- 172.21.15.26:0/2346088813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0280b3fd0 msgr2=0x7ff02815d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff0301a7700 1 --2- 172.21.15.26:0/2346088813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0280b3fd0 0x7ff02815d3a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff028063e00 tx=0x7ff01c009250 comp rx=0 tx=0).stop 2023-09-28T00:15:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff0301a7700 1 -- 172.21.15.26:0/2346088813 shutdown_connections 2023-09-28T00:15:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff0301a7700 1 --2- 172.21.15.26:0/2346088813 >> v2:172.21.15.190:3300/0 conn(0x7ff028159500 0x7ff0281598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff0301a7700 1 --2- 172.21.15.26:0/2346088813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff0280b3fd0 0x7ff02815d3a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff0301a7700 1 -- 172.21.15.26:0/2346088813 >> 172.21.15.26:0/2346088813 conn(0x7ff028067630 msgr2=0x7ff028069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff0301a7700 1 -- 172.21.15.26:0/2346088813 shutdown_connections 2023-09-28T00:15:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.815+0000 7ff0301a7700 1 -- 172.21.15.26:0/2346088813 wait complete. 2023-09-28T00:15:47.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.816+0000 7ff0301a7700 1 Processor -- start 2023-09-28T00:15:47.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.816+0000 7ff0301a7700 1 -- start start 2023-09-28T00:15:47.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff0301a7700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0280b3fd0 0x7ff0281399d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff0301a7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028159500 0x7ff02816b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff0301a7700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff02815d8e0 0x7ff02814cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff0301a7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02816af10 con 0x7ff028159500 2023-09-28T00:15:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff0301a7700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0280684d0 con 0x7ff0280b3fd0 2023-09-28T00:15:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff0301a7700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff028067ba0 con 0x7ff02815d8e0 2023-09-28T00:15:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff02d742700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028159500 0x7ff02816b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff02d742700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028159500 0x7ff02816b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40146/0 (socket says 172.21.15.26:40146) 2023-09-28T00:15:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff02d742700 1 -- 172.21.15.26:0/2433892504 learned_addr learned my addr 172.21.15.26:0/2433892504 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.817+0000 7ff02df43700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0280b3fd0 0x7ff0281399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff02e744700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff02815d8e0 0x7ff02814cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff02d742700 1 -- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff02815d8e0 msgr2=0x7ff02814cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff02d742700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff02815d8e0 0x7ff02814cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff02d742700 1 -- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0280b3fd0 msgr2=0x7ff0281399d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff02d742700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0280b3fd0 0x7ff0281399d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff02d742700 1 -- 172.21.15.26:0/2433892504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0094f0 con 0x7ff028159500 2023-09-28T00:15:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff02df43700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0280b3fd0 0x7ff0281399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff02e744700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff02815d8e0 0x7ff02814cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff02d742700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028159500 0x7ff02816b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0030c0 tx=0x7ff01c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:47.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff025ffb700 1 -- 172.21.15.26:0/2433892504 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00bd10 con 0x7ff028159500 2023-09-28T00:15:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff025ffb700 1 -- 172.21.15.26:0/2433892504 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c020070 con 0x7ff028159500 2023-09-28T00:15:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff028067e80 con 0x7ff028159500 2023-09-28T00:15:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff025ffb700 1 -- 172.21.15.26:0/2433892504 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c01b6c0 con 0x7ff028159500 2023-09-28T00:15:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.818+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff028139f10 con 0x7ff028159500 2023-09-28T00:15:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.819+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff028068660 con 0x7ff028159500 2023-09-28T00:15:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.819+0000 7ff025ffb700 1 -- 172.21.15.26:0/2433892504 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7ff01c022030 con 0x7ff028159500 2023-09-28T00:15:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.820+0000 7ff025ffb700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff014067330 0x7ff0140697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:47.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.820+0000 7ff025ffb700 1 -- 172.21.15.26:0/2433892504 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff01c086bc0 con 0x7ff028159500 2023-09-28T00:15:47.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.820+0000 7ff02df43700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff014067330 0x7ff0140697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:47.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.821+0000 7ff02df43700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff014067330 0x7ff0140697e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff01800d640 tx=0x7ff018007670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:47.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:47.824+0000 7ff025ffb700 1 -- 172.21.15.26:0/2433892504 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7ff01c053ac0 con 0x7ff028159500 2023-09-28T00:15:48.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.021+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff028068610 con 0x7ff014067330 2023-09-28T00:15:48.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.022+0000 7ff025ffb700 1 -- 172.21.15.26:0/2433892504 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff028068610 con 0x7ff014067330 2023-09-28T00:15:48.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff014067330 msgr2=0x7ff0140697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff014067330 0x7ff0140697e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff01800d640 tx=0x7ff018007670 comp rx=0 tx=0).stop 2023-09-28T00:15:48.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028159500 msgr2=0x7ff02816b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028159500 0x7ff02816b0d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0030c0 tx=0x7ff01c016000 comp rx=0 tx=0).stop 2023-09-28T00:15:48.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 shutdown_connections 2023-09-28T00:15:48.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7ff014067330 0x7ff0140697e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff02815d8e0 0x7ff02814cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff0280b3fd0 0x7ff0281399d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 --2- 172.21.15.26:0/2433892504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff028159500 0x7ff02816b0d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 >> 172.21.15.26:0/2433892504 conn(0x7ff028067630 msgr2=0x7ff0280b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:48.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 shutdown_connections 2023-09-28T00:15:48.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.024+0000 7ff0301a7700 1 -- 172.21.15.26:0/2433892504 wait complete. 2023-09-28T00:15:48.027 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 0 to deep-scrub 2023-09-28T00:15:48.037 INFO:tasks.ceph:Scrubbing osd.1 2023-09-28T00:15:48.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:15:48.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.159+0000 7effb0107700 1 Processor -- start 2023-09-28T00:15:48.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.160+0000 7effb0107700 1 -- start start 2023-09-28T00:15:48.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.160+0000 7effb0107700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7effa80ccbe0 0x7effa80b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.160+0000 7effb0107700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d0f00 0x7effa80ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.160+0000 7effb0107700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa80cbed0 con 0x7effa80b55b0 2023-09-28T00:15:48.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.160+0000 7effb0107700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa8159d40 con 0x7effa80ccbe0 2023-09-28T00:15:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.160+0000 7effb0107700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa80cc750 con 0x7effa80d0f00 2023-09-28T00:15:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effad6a2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7effa80ccbe0 0x7effa80b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effae6a4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d0f00 0x7effa80ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effadea3700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7effa80b55b0 0x7effa80cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:34284/0 (socket says 172.21.15.26:34284) 2023-09-28T00:15:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effadea3700 1 -- 172.21.15.26:0/4257127995 learned_addr learned my addr 172.21.15.26:0/4257127995 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:48.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effae6a4700 1 -- 172.21.15.26:0/4257127995 >> v2:172.21.15.190:3300/0 conn(0x7effa80ccbe0 msgr2=0x7effa80b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effae6a4700 1 --2- 172.21.15.26:0/4257127995 >> v2:172.21.15.190:3300/0 conn(0x7effa80ccbe0 0x7effa80b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effae6a4700 1 -- 172.21.15.26:0/4257127995 >> v1:172.21.15.190:6789/0 conn(0x7effa80b55b0 legacy=0x7effa80cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effae6a4700 1 -- 172.21.15.26:0/4257127995 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80cd050 con 0x7effa80d0f00 2023-09-28T00:15:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effad6a2700 1 --2- 172.21.15.26:0/4257127995 >> v2:172.21.15.190:3300/0 conn(0x7effa80ccbe0 0x7effa80b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effae6a4700 1 --2- 172.21.15.26:0/4257127995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d0f00 0x7effa80ce270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff98009e60 tx=0x7eff98009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f28b4f536600c35 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effacea1700 1 -- 172.21.15.26:0/4257127995 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9800e070 con 0x7effa80d0f00 2023-09-28T00:15:48.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effacea1700 1 -- 172.21.15.26:0/4257127995 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9800bb60 con 0x7effa80d0f00 2023-09-28T00:15:48.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.161+0000 7effacea1700 1 -- 172.21.15.26:0/4257127995 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98012430 con 0x7effa80d0f00 2023-09-28T00:15:48.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.162+0000 7effb0107700 1 -- 172.21.15.26:0/4257127995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d0f00 msgr2=0x7effa80ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.162+0000 7effb0107700 1 --2- 172.21.15.26:0/4257127995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d0f00 0x7effa80ce270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7eff98009e60 tx=0x7eff98009780 comp rx=0 tx=0).stop 2023-09-28T00:15:48.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.162+0000 7effb0107700 1 -- 172.21.15.26:0/4257127995 shutdown_connections 2023-09-28T00:15:48.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.162+0000 7effb0107700 1 --2- 172.21.15.26:0/4257127995 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80d0f00 0x7effa80ce270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.162+0000 7effb0107700 1 --2- 172.21.15.26:0/4257127995 >> v2:172.21.15.190:3300/0 conn(0x7effa80ccbe0 0x7effa80b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.162+0000 7effb0107700 1 -- 172.21.15.26:0/4257127995 >> 172.21.15.26:0/4257127995 conn(0x7effa808a050 msgr2=0x7effa8099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:48.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.162+0000 7effb0107700 1 -- 172.21.15.26:0/4257127995 shutdown_connections 2023-09-28T00:15:48.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.162+0000 7effb0107700 1 -- 172.21.15.26:0/4257127995 wait complete. 2023-09-28T00:15:48.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.163+0000 7effb0107700 1 Processor -- start 2023-09-28T00:15:48.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.163+0000 7effb0107700 1 -- start start 2023-09-28T00:15:48.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effb0107700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80b55b0 0x7effa8157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effb0107700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa80ccbe0 0x7effa815bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effb0107700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effa80d0f00 0x7effa815c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effb0107700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa80b0c70 con 0x7effa80ccbe0 2023-09-28T00:15:48.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effb0107700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa81580e0 con 0x7effa80d0f00 2023-09-28T00:15:48.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effb0107700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa81585f0 con 0x7effa80b55b0 2023-09-28T00:15:48.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effad6a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa80ccbe0 0x7effa815bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effad6a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa80ccbe0 0x7effa815bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40148/0 (socket says 172.21.15.26:40148) 2023-09-28T00:15:48.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effad6a2700 1 -- 172.21.15.26:0/4243024519 learned_addr learned my addr 172.21.15.26:0/4243024519 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:48.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effadea3700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80b55b0 0x7effa8157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effae6a4700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effa80d0f00 0x7effa815c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effad6a2700 1 -- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80b55b0 msgr2=0x7effa8157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effad6a2700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effa80b55b0 0x7effa8157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effad6a2700 1 -- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effa80d0f00 msgr2=0x7effa815c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effad6a2700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effa80d0f00 0x7effa815c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.164+0000 7effad6a2700 1 -- 172.21.15.26:0/4243024519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c009420 con 0x7effa80ccbe0 2023-09-28T00:15:48.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.165+0000 7effad6a2700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa80ccbe0 0x7effa815bf90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00ece0 tx=0x7eff9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.165+0000 7effa5ffb700 1 -- 172.21.15.26:0/4243024519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00c920 con 0x7effa80ccbe0 2023-09-28T00:15:48.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.165+0000 7effa5ffb700 1 -- 172.21.15.26:0/4243024519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9c00ca80 con 0x7effa80ccbe0 2023-09-28T00:15:48.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.165+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff98009a20 con 0x7effa80ccbe0 2023-09-28T00:15:48.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.165+0000 7effa5ffb700 1 -- 172.21.15.26:0/4243024519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00ce00 con 0x7effa80ccbe0 2023-09-28T00:15:48.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.165+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa80c9d10 con 0x7effa80ccbe0 2023-09-28T00:15:48.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.166+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effa80717c0 con 0x7effa80ccbe0 2023-09-28T00:15:48.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.166+0000 7effa5ffb700 1 -- 172.21.15.26:0/4243024519 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7eff9c013680 con 0x7effa80ccbe0 2023-09-28T00:15:48.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.167+0000 7effa5ffb700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7eff94067330 0x7eff940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.167+0000 7effa5ffb700 1 -- 172.21.15.26:0/4243024519 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff9c084e40 con 0x7effa80ccbe0 2023-09-28T00:15:48.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.167+0000 7effa5ffb700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7eff9406fbe0 0x7eff94071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.167+0000 7effa5ffb700 1 -- 172.21.15.26:0/4243024519 --> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff940726a0 con 0x7eff9406fbe0 2023-09-28T00:15:48.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.167+0000 7effa5ffb700 1 -- 172.21.15.26:0/4243024519 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff9c087480 con 0x7effa80ccbe0 2023-09-28T00:15:48.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.167+0000 7effadea3700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7eff94067330 0x7eff940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.174 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.167+0000 7effae6a4700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7eff9406fbe0 0x7eff94071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.167+0000 7effae6a4700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7eff9406fbe0 0x7eff94071ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.168+0000 7effadea3700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7eff94067330 0x7eff940697e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effa80ad5f0 tx=0x7effa0007f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.168+0000 7effa5ffb700 1 -- 172.21.15.26:0/4243024519 <== osd.1 v2:172.21.15.26:6808/90239 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7eff940726a0 con 0x7eff9406fbe0 2023-09-28T00:15:48.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 --> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7effa80cf5e0 con 0x7eff9406fbe0 2023-09-28T00:15:48.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effa5ffb700 1 -- 172.21.15.26:0/4243024519 <== osd.1 v2:172.21.15.26:6808/90239 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7effa80cf5e0 con 0x7eff9406fbe0 2023-09-28T00:15:48.184 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-09-28T00:15:48.184 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:15:48.184 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-09-28T00:15:48.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7eff9406fbe0 msgr2=0x7eff94071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effb0107700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.26:6808/90239,v1:172.21.15.26:6809/90239] conn(0x7eff9406fbe0 0x7eff94071ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7eff94067330 msgr2=0x7eff940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effb0107700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7eff94067330 0x7eff940697e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effa80ad5f0 tx=0x7effa0007f00 comp rx=0 tx=0).stop 2023-09-28T00:15:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa80ccbe0 msgr2=0x7effa815bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effb0107700 1 --2- 172.21.15.26:0/4243024519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effa80ccbe0 0x7effa815bf90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00ece0 tx=0x7eff9c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effae6a4700 1 -- 172.21.15.26:0/4243024519 reap_dead start 2023-09-28T00:15:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 shutdown_connections 2023-09-28T00:15:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.182+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 >> 172.21.15.26:0/4243024519 conn(0x7effa808a050 msgr2=0x7effa80ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.183+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 shutdown_connections 2023-09-28T00:15:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.183+0000 7effb0107700 1 -- 172.21.15.26:0/4243024519 wait complete. 2023-09-28T00:15:48.195 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-28T00:15:48.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.314+0000 7efd8885d700 1 Processor -- start 2023-09-28T00:15:48.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.314+0000 7efd8885d700 1 -- start start 2023-09-28T00:15:48.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd8885d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd84142df0 0x7efd840b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd8885d700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efd8415d860 0x7efd840b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd8885d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd840b1880 con 0x7efd840b13e0 2023-09-28T00:15:48.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd8885d700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd840b2920 con 0x7efd8415d860 2023-09-28T00:15:48.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd8885d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd840b1b60 con 0x7efd84142df0 2023-09-28T00:15:48.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd837fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd84142df0 0x7efd840b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd83fff700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efd8415d860 0x7efd840b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd837fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd84142df0 0x7efd840b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:41422/0 (socket says 172.21.15.26:41422) 2023-09-28T00:15:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd837fe700 1 -- 172.21.15.26:0/63825889 learned_addr learned my addr 172.21.15.26:0/63825889 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.315+0000 7efd837fe700 1 -- 172.21.15.26:0/63825889 >> v2:172.21.15.190:3300/0 conn(0x7efd8415d860 msgr2=0x7efd840b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd837fe700 1 --2- 172.21.15.26:0/63825889 >> v2:172.21.15.190:3300/0 conn(0x7efd8415d860 0x7efd840b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd837fe700 1 -- 172.21.15.26:0/63825889 >> v1:172.21.15.190:6789/0 conn(0x7efd840b13e0 legacy=0x7efd8415d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd837fe700 1 -- 172.21.15.26:0/63825889 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd840b1e40 con 0x7efd84142df0 2023-09-28T00:15:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd837fe700 1 --2- 172.21.15.26:0/63825889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd84142df0 0x7efd840b0ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd740099b0 tx=0x7efd74009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c9b5d5f05b15bed server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd827fc700 1 -- 172.21.15.26:0/63825889 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74009ea0 con 0x7efd84142df0 2023-09-28T00:15:48.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd827fc700 1 -- 172.21.15.26:0/63825889 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7400b860 con 0x7efd84142df0 2023-09-28T00:15:48.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd827fc700 1 -- 172.21.15.26:0/63825889 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400bc00 con 0x7efd84142df0 2023-09-28T00:15:48.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd8885d700 1 -- 172.21.15.26:0/63825889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd84142df0 msgr2=0x7efd840b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd8885d700 1 --2- 172.21.15.26:0/63825889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd84142df0 0x7efd840b0ea0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd740099b0 tx=0x7efd74009250 comp rx=0 tx=0).stop 2023-09-28T00:15:48.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd8885d700 1 -- 172.21.15.26:0/63825889 shutdown_connections 2023-09-28T00:15:48.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd8885d700 1 --2- 172.21.15.26:0/63825889 >> v2:172.21.15.190:3300/0 conn(0x7efd8415d860 0x7efd840b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd8885d700 1 --2- 172.21.15.26:0/63825889 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd84142df0 0x7efd840b0ea0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd8885d700 1 -- 172.21.15.26:0/63825889 >> 172.21.15.26:0/63825889 conn(0x7efd84067630 msgr2=0x7efd84069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:48.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd8885d700 1 -- 172.21.15.26:0/63825889 shutdown_connections 2023-09-28T00:15:48.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.316+0000 7efd8885d700 1 -- 172.21.15.26:0/63825889 wait complete. 2023-09-28T00:15:48.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.318+0000 7efd8885d700 1 Processor -- start 2023-09-28T00:15:48.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.318+0000 7efd8885d700 1 -- start start 2023-09-28T00:15:48.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.318+0000 7efd8885d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd840b13e0 0x7efd840a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.318+0000 7efd8885d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd84142df0 0x7efd84134d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.318+0000 7efd8885d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8415d860 0x7efd840ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.318+0000 7efd8885d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd840a8fe0 con 0x7efd84142df0 2023-09-28T00:15:48.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.318+0000 7efd8885d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd840a7d00 con 0x7efd8415d860 2023-09-28T00:15:48.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.318+0000 7efd8885d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd840abbf0 con 0x7efd840b13e0 2023-09-28T00:15:48.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd837fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd840b13e0 0x7efd840a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd82ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd84142df0 0x7efd84134d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd837fe700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd840b13e0 0x7efd840a8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:41432/0 (socket says 172.21.15.26:41432) 2023-09-28T00:15:48.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd837fe700 1 -- 172.21.15.26:0/1431564366 learned_addr learned my addr 172.21.15.26:0/1431564366 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:48.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd83fff700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8415d860 0x7efd840ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd837fe700 1 -- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8415d860 msgr2=0x7efd840ab1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd837fe700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8415d860 0x7efd840ab1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd837fe700 1 -- 172.21.15.26:0/1431564366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd84142df0 msgr2=0x7efd84134d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd837fe700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd84142df0 0x7efd84134d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd837fe700 1 -- 172.21.15.26:0/1431564366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd740094f0 con 0x7efd840b13e0 2023-09-28T00:15:48.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd837fe700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd840b13e0 0x7efd840a8aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd74006fd0 tx=0x7efd74017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.325 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd6b7fe700 1 -- 172.21.15.26:0/1431564366 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7400bbe0 con 0x7efd840b13e0 2023-09-28T00:15:48.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd6b7fe700 1 -- 172.21.15.26:0/1431564366 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74000c90 con 0x7efd840b13e0 2023-09-28T00:15:48.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd6b7fe700 1 -- 172.21.15.26:0/1431564366 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74011650 con 0x7efd840b13e0 2023-09-28T00:15:48.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd840a7fc0 con 0x7efd840b13e0 2023-09-28T00:15:48.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.319+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd840a8580 con 0x7efd840b13e0 2023-09-28T00:15:48.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.320+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8404c3c0 con 0x7efd840b13e0 2023-09-28T00:15:48.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.321+0000 7efd6b7fe700 1 -- 172.21.15.26:0/1431564366 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efd74011a40 con 0x7efd840b13e0 2023-09-28T00:15:48.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.321+0000 7efd6b7fe700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efd70067330 0x7efd700697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.326 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.321+0000 7efd6b7fe700 1 -- 172.21.15.26:0/1431564366 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efd740861a0 con 0x7efd840b13e0 2023-09-28T00:15:48.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.321+0000 7efd82ffd700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efd70067330 0x7efd700697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.322+0000 7efd82ffd700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efd70067330 0x7efd700697e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd840b17b0 tx=0x7efd78007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.326+0000 7efd6b7fe700 1 -- 172.21.15.26:0/1431564366 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efd74053200 con 0x7efd840b13e0 2023-09-28T00:15:48.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.517+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7efd840b2120 con 0x7efd70067330 2023-09-28T00:15:48.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.518+0000 7efd6b7fe700 1 -- 172.21.15.26:0/1431564366 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efd840b2120 con 0x7efd70067330 2023-09-28T00:15:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efd70067330 msgr2=0x7efd700697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efd70067330 0x7efd700697e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd840b17b0 tx=0x7efd78007ec0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd840b13e0 msgr2=0x7efd840a8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd840b13e0 0x7efd840a8aa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efd74006fd0 tx=0x7efd74017000 comp rx=0 tx=0).stop 2023-09-28T00:15:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 shutdown_connections 2023-09-28T00:15:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efd70067330 0x7efd700697e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd840b13e0 0x7efd840a8aa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8415d860 0x7efd840ab1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 --2- 172.21.15.26:0/1431564366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd84142df0 0x7efd84134d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 >> 172.21.15.26:0/1431564366 conn(0x7efd84067630 msgr2=0x7efd841415d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 shutdown_connections 2023-09-28T00:15:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.520+0000 7efd8885d700 1 -- 172.21.15.26:0/1431564366 wait complete. 2023-09-28T00:15:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 1 to deep-scrub 2023-09-28T00:15:48.533 INFO:tasks.ceph:Scrubbing osd.2 2023-09-28T00:15:48.533 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:15:48.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.656+0000 7f683304c700 1 Processor -- start 2023-09-28T00:15:48.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.656+0000 7f683304c700 1 -- start start 2023-09-28T00:15:48.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.657+0000 7f683304c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f682c0b55b0 0x7f682c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.657+0000 7f683304c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0cf800 0x7f682c0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.657+0000 7f683304c700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c0cbed0 con 0x7f682c0d0f00 2023-09-28T00:15:48.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.657+0000 7f683304c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f682c159d40 con 0x7f682c0b55b0 2023-09-28T00:15:48.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.657+0000 7f683304c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0cc750 con 0x7f682c0cf800 2023-09-28T00:15:48.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.657+0000 7f682bfff700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0cf800 0x7f682c0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.657+0000 7f6830de8700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f682c0b55b0 0x7f682c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.657+0000 7f68315e9700 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f682c0d0f00 0x7f682c0ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:34294/0 (socket says 172.21.15.26:34294) 2023-09-28T00:15:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.657+0000 7f68315e9700 1 -- 172.21.15.26:0/1511261677 learned_addr learned my addr 172.21.15.26:0/1511261677 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f6830de8700 1 -- 172.21.15.26:0/1511261677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0cf800 msgr2=0x7f682c0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f6830de8700 1 --2- 172.21.15.26:0/1511261677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0cf800 0x7f682c0b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f6830de8700 1 -- 172.21.15.26:0/1511261677 >> v1:172.21.15.190:6789/0 conn(0x7f682c0d0f00 legacy=0x7f682c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f6830de8700 1 -- 172.21.15.26:0/1511261677 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0b5ec0 con 0x7f682c0b55b0 2023-09-28T00:15:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f682bfff700 1 --2- 172.21.15.26:0/1511261677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0cf800 0x7f682c0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:48.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f682b7fe700 1 -- 172.21.15.26:0/1511261677 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650956412 0 0) 0x7f682c0cbed0 con 0x7f682c0d0f00 2023-09-28T00:15:48.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f6830de8700 1 --2- 172.21.15.26:0/1511261677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682c0b55b0 0x7f682c0ccbe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68200098d0 tx=0x7f6820009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=852ced4c7c6d11c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f682b7fe700 1 -- 172.21.15.26:0/1511261677 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820005c10 con 0x7f682c0b55b0 2023-09-28T00:15:48.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f682b7fe700 1 -- 172.21.15.26:0/1511261677 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6820005d70 con 0x7f682c0b55b0 2023-09-28T00:15:48.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.658+0000 7f682b7fe700 1 -- 172.21.15.26:0/1511261677 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820006260 con 0x7f682c0b55b0 2023-09-28T00:15:48.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.659+0000 7f683304c700 1 -- 172.21.15.26:0/1511261677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682c0b55b0 msgr2=0x7f682c0ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.659+0000 7f683304c700 1 --2- 172.21.15.26:0/1511261677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682c0b55b0 0x7f682c0ccbe0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68200098d0 tx=0x7f6820009120 comp rx=0 tx=0).stop 2023-09-28T00:15:48.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.659+0000 7f683304c700 1 -- 172.21.15.26:0/1511261677 shutdown_connections 2023-09-28T00:15:48.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.659+0000 7f683304c700 1 --2- 172.21.15.26:0/1511261677 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682c0b55b0 0x7f682c0ccbe0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.659+0000 7f683304c700 1 --2- 172.21.15.26:0/1511261677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0cf800 0x7f682c0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.659+0000 7f683304c700 1 -- 172.21.15.26:0/1511261677 >> 172.21.15.26:0/1511261677 conn(0x7f682c08a050 msgr2=0x7f682c099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:48.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.659+0000 7f683304c700 1 -- 172.21.15.26:0/1511261677 shutdown_connections 2023-09-28T00:15:48.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.659+0000 7f683304c700 1 -- 172.21.15.26:0/1511261677 wait complete. 2023-09-28T00:15:48.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.660+0000 7f683304c700 1 Processor -- start 2023-09-28T00:15:48.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.660+0000 7f683304c700 1 -- start start 2023-09-28T00:15:48.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f683304c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f682c0b55b0 0x7f682c15ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f683304c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682c0cf800 0x7f682c0ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f683304c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0d0f00 0x7f682c16cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f683304c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c16db40 con 0x7f682c0b55b0 2023-09-28T00:15:48.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f683304c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c15e9f0 con 0x7f682c0cf800 2023-09-28T00:15:48.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f683304c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c15e140 con 0x7f682c0d0f00 2023-09-28T00:15:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6830de8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f682c0b55b0 0x7f682c15ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6830de8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f682c0b55b0 0x7f682c15ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40170/0 (socket says 172.21.15.26:40170) 2023-09-28T00:15:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6830de8700 1 -- 172.21.15.26:0/1320672195 learned_addr learned my addr 172.21.15.26:0/1320672195 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f682bfff700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682c0cf800 0x7f682c0ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f68315e9700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0d0f00 0x7f682c16cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6830de8700 1 -- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0d0f00 msgr2=0x7f682c16cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6830de8700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f682c0d0f00 0x7f682c16cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6830de8700 1 -- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682c0cf800 msgr2=0x7f682c0ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6830de8700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682c0cf800 0x7f682c0ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6830de8700 1 -- 172.21.15.26:0/1320672195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6818009420 con 0x7f682c0b55b0 2023-09-28T00:15:48.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f682bfff700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f682c0cf800 0x7f682c0ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:48.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6830de8700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f682c0b55b0 0x7f682c15ee80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6820009f70 tx=0x7f6820016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6828ff9700 1 -- 172.21.15.26:0/1320672195 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820005c10 con 0x7f682c0b55b0 2023-09-28T00:15:48.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f6828ff9700 1 -- 172.21.15.26:0/1320672195 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682001d6b0 con 0x7f682c0b55b0 2023-09-28T00:15:48.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.661+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68200093c0 con 0x7f682c0b55b0 2023-09-28T00:15:48.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.662+0000 7f6828ff9700 1 -- 172.21.15.26:0/1320672195 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682001da70 con 0x7f682c0b55b0 2023-09-28T00:15:48.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.662+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c15e680 con 0x7f682c0b55b0 2023-09-28T00:15:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.662+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f682c0717c0 con 0x7f682c0b55b0 2023-09-28T00:15:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.663+0000 7f6828ff9700 1 -- 172.21.15.26:0/1320672195 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f682001b480 con 0x7f682c0b55b0 2023-09-28T00:15:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.663+0000 7f6828ff9700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6810067330 0x7f68100697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.663+0000 7f6828ff9700 1 -- 172.21.15.26:0/1320672195 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6820086880 con 0x7f682c0b55b0 2023-09-28T00:15:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.663+0000 7f6828ff9700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f681006fbe0 0x7f6810071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.663+0000 7f6828ff9700 1 -- 172.21.15.26:0/1320672195 --> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68100726a0 con 0x7f681006fbe0 2023-09-28T00:15:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.663+0000 7f6828ff9700 1 -- 172.21.15.26:0/1320672195 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f682008b240 con 0x7f682c0b55b0 2023-09-28T00:15:48.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.663+0000 7f682bfff700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6810067330 0x7f68100697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.663+0000 7f68315e9700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f681006fbe0 0x7f6810071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.664+0000 7f68315e9700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f681006fbe0 0x7f6810071ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.664+0000 7f682bfff700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6810067330 0x7f68100697e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f68180093f0 tx=0x7f6818008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.670 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.664+0000 7f6828ff9700 1 -- 172.21.15.26:0/1320672195 <== osd.2 v2:172.21.15.26:6800/90240 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f68100726a0 con 0x7f681006fbe0 2023-09-28T00:15:48.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.678+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 --> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f682c0cffe0 con 0x7f681006fbe0 2023-09-28T00:15:48.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f6828ff9700 1 -- 172.21.15.26:0/1320672195 <== osd.2 v2:172.21.15.26:6800/90240 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f682c0cffe0 con 0x7f681006fbe0 2023-09-28T00:15:48.680 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-09-28T00:15:48.680 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:15:48.680 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-09-28T00:15:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f681006fbe0 msgr2=0x7f6810071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.26:6800/90240,v1:172.21.15.26:6801/90240] conn(0x7f681006fbe0 0x7f6810071ff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6810067330 msgr2=0x7f68100697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6810067330 0x7f68100697e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f68180093f0 tx=0x7f6818008040 comp rx=0 tx=0).stop 2023-09-28T00:15:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f682c0b55b0 msgr2=0x7f682c15ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 --2- 172.21.15.26:0/1320672195 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f682c0b55b0 0x7f682c15ee80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6820009f70 tx=0x7f6820016000 comp rx=0 tx=0).stop 2023-09-28T00:15:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f68315e9700 1 -- 172.21.15.26:0/1320672195 reap_dead start 2023-09-28T00:15:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 shutdown_connections 2023-09-28T00:15:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 >> 172.21.15.26:0/1320672195 conn(0x7f682c08a050 msgr2=0x7f682c159e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 shutdown_connections 2023-09-28T00:15:48.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.679+0000 7f683304c700 1 -- 172.21.15.26:0/1320672195 wait complete. 2023-09-28T00:15:48.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-28T00:15:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.811+0000 7fc209a96700 1 Processor -- start 2023-09-28T00:15:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.811+0000 7fc209a96700 1 -- start start 2023-09-28T00:15:48.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.811+0000 7fc209a96700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc2041598d0 0x7fc20415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.811+0000 7fc209a96700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20415dd20 con 0x7fc20415d8e0 2023-09-28T00:15:48.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.811+0000 7fc209a96700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2040b1110 con 0x7fc204159500 2023-09-28T00:15:48.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.811+0000 7fc209a96700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2040b13b0 con 0x7fc2041598d0 2023-09-28T00:15:48.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc202ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc2041598d0 0x7fc20415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc203fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc20415d8e0 0x7fc2040cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49270/0 (socket says 172.21.15.26:49270) 2023-09-28T00:15:48.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc203fff700 1 -- 172.21.15.26:0/2990281863 learned_addr learned my addr 172.21.15.26:0/2990281863 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:48.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc202ffd700 1 -- 172.21.15.26:0/2990281863 >> v1:172.21.15.190:6789/0 conn(0x7fc204159500 legacy=0x7fc2040b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:48.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc202ffd700 1 -- 172.21.15.26:0/2990281863 >> v1:172.21.15.26:6789/0 conn(0x7fc20415d8e0 legacy=0x7fc2040cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc202ffd700 1 -- 172.21.15.26:0/2990281863 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2040b1690 con 0x7fc2041598d0 2023-09-28T00:15:48.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc2027fc700 1 -- 172.21.15.26:0/2990281863 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991809814 0 0) 0x7fc20415dd20 con 0x7fc20415d8e0 2023-09-28T00:15:48.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc202ffd700 1 --2- 172.21.15.26:0/2990281863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2041598d0 0x7fc20415d3a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80098e0 tx=0x7fc1f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be3338b930f51cb server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc2027fc700 1 -- 172.21.15.26:0/2990281863 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8009e80 con 0x7fc2041598d0 2023-09-28T00:15:48.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc2027fc700 1 -- 172.21.15.26:0/2990281863 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f800b820 con 0x7fc2041598d0 2023-09-28T00:15:48.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.812+0000 7fc2027fc700 1 -- 172.21.15.26:0/2990281863 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f800bba0 con 0x7fc2041598d0 2023-09-28T00:15:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.813+0000 7fc209a96700 1 -- 172.21.15.26:0/2990281863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2041598d0 msgr2=0x7fc20415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.813+0000 7fc209a96700 1 --2- 172.21.15.26:0/2990281863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2041598d0 0x7fc20415d3a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80098e0 tx=0x7fc1f80091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.813+0000 7fc209a96700 1 -- 172.21.15.26:0/2990281863 shutdown_connections 2023-09-28T00:15:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.813+0000 7fc209a96700 1 --2- 172.21.15.26:0/2990281863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2041598d0 0x7fc20415d3a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.813+0000 7fc209a96700 1 -- 172.21.15.26:0/2990281863 >> 172.21.15.26:0/2990281863 conn(0x7fc204067630 msgr2=0x7fc204069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.813+0000 7fc209a96700 1 -- 172.21.15.26:0/2990281863 shutdown_connections 2023-09-28T00:15:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.813+0000 7fc209a96700 1 -- 172.21.15.26:0/2990281863 wait complete. 2023-09-28T00:15:48.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.814+0000 7fc209a96700 1 Processor -- start 2023-09-28T00:15:48.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.814+0000 7fc209a96700 1 -- start start 2023-09-28T00:15:48.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc209a96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc204159500 0x7fc2040b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc209a96700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2041598d0 0x7fc20414edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc209a96700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc20415d8e0 0x7fc20414f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc209a96700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20414f850 con 0x7fc204159500 2023-09-28T00:15:48.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc209a96700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040b4170 con 0x7fc20415d8e0 2023-09-28T00:15:48.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc209a96700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2040b4450 con 0x7fc2041598d0 2023-09-28T00:15:48.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc2037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc204159500 0x7fc2040b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc2037fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc204159500 0x7fc2040b20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40200/0 (socket says 172.21.15.26:40200) 2023-09-28T00:15:48.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc2037fe700 1 -- 172.21.15.26:0/26730321 learned_addr learned my addr 172.21.15.26:0/26730321 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:48.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc203fff700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc20415d8e0 0x7fc20414f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc202ffd700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2041598d0 0x7fc20414edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc2037fe700 1 -- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2041598d0 msgr2=0x7fc20414edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc2037fe700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2041598d0 0x7fc20414edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc2037fe700 1 -- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc20415d8e0 msgr2=0x7fc20414f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:48.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc2037fe700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc20415d8e0 0x7fc20414f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:48.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc2037fe700 1 -- 172.21.15.26:0/26730321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f8009420 con 0x7fc204159500 2023-09-28T00:15:48.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc2037fe700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc204159500 0x7fc2040b20e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400c5d0 tx=0x7fc1f4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc1eb7fe700 1 -- 172.21.15.26:0/26730321 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4011590 con 0x7fc204159500 2023-09-28T00:15:48.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc1eb7fe700 1 -- 172.21.15.26:0/26730321 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f4011710 con 0x7fc204159500 2023-09-28T00:15:48.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2040b4730 con 0x7fc204159500 2023-09-28T00:15:48.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc1eb7fe700 1 -- 172.21.15.26:0/26730321 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4011ad0 con 0x7fc204159500 2023-09-28T00:15:48.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.815+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2040b2620 con 0x7fc204159500 2023-09-28T00:15:48.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.816+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20415e1a0 con 0x7fc204159500 2023-09-28T00:15:48.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.817+0000 7fc1eb7fe700 1 -- 172.21.15.26:0/26730321 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc1f401c460 con 0x7fc204159500 2023-09-28T00:15:48.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.817+0000 7fc1eb7fe700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc1f0067360 0x7fc1f0069810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:48.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.817+0000 7fc1eb7fe700 1 -- 172.21.15.26:0/26730321 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc1f4084850 con 0x7fc204159500 2023-09-28T00:15:48.824 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.817+0000 7fc202ffd700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc1f0067360 0x7fc1f0069810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:48.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.818+0000 7fc202ffd700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc1f0067360 0x7fc1f0069810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80030c0 tx=0x7fc1f8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:48.825 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:48.821+0000 7fc1eb7fe700 1 -- 172.21.15.26:0/26730321 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc1f4051750 con 0x7fc204159500 2023-09-28T00:15:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.016+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2040b42e0 con 0x7fc1f0067360 2023-09-28T00:15:49.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.016+0000 7fc1eb7fe700 1 -- 172.21.15.26:0/26730321 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc2040b42e0 con 0x7fc1f0067360 2023-09-28T00:15:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc1f0067360 msgr2=0x7fc1f0069810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc1f0067360 0x7fc1f0069810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc1f80030c0 tx=0x7fc1f8016000 comp rx=0 tx=0).stop 2023-09-28T00:15:49.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc204159500 msgr2=0x7fc2040b20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc204159500 0x7fc2040b20e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc1f400c5d0 tx=0x7fc1f4007f60 comp rx=0 tx=0).stop 2023-09-28T00:15:49.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 shutdown_connections 2023-09-28T00:15:49.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc1f0067360 0x7fc1f0069810 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc20415d8e0 0x7fc20414f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc204159500 0x7fc2040b20e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 --2- 172.21.15.26:0/26730321 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc2041598d0 0x7fc20414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 >> 172.21.15.26:0/26730321 conn(0x7fc204067630 msgr2=0x7fc20414b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:49.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 shutdown_connections 2023-09-28T00:15:49.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.018+0000 7fc209a96700 1 -- 172.21.15.26:0/26730321 wait complete. 2023-09-28T00:15:49.022 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 2 to deep-scrub 2023-09-28T00:15:49.031 INFO:tasks.ceph:Scrubbing osd.3 2023-09-28T00:15:49.032 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:15:49.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.154+0000 7fafde963700 1 Processor -- start 2023-09-28T00:15:49.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.154+0000 7fafde963700 1 -- start start 2023-09-28T00:15:49.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.154+0000 7fafde963700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fafd80b55b0 0x7fafd80ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.154+0000 7fafde963700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafd80d0f00 0x7fafd80ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafde963700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafd80cbed0 con 0x7fafd80cf800 2023-09-28T00:15:49.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafde963700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafd8159d40 con 0x7fafd80b55b0 2023-09-28T00:15:49.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafde963700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd80cc750 con 0x7fafd80d0f00 2023-09-28T00:15:49.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fafd80b55b0 0x7fafd80ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd7fff700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fafd80b55b0 0x7fafd80ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40202/0 (socket says 172.21.15.26:40202) 2023-09-28T00:15:49.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd7fff700 1 -- 172.21.15.26:0/3604811998 learned_addr learned my addr 172.21.15.26:0/3604811998 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:49.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafdcf00700 1 --2- 172.21.15.26:0/3604811998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafd80d0f00 0x7fafd80ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd7fff700 1 -- 172.21.15.26:0/3604811998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafd80d0f00 msgr2=0x7fafd80ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:49.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd7fff700 1 --2- 172.21.15.26:0/3604811998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafd80d0f00 0x7fafd80ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd7fff700 1 -- 172.21.15.26:0/3604811998 >> v1:172.21.15.190:6789/0 conn(0x7fafd80cf800 legacy=0x7fafd80b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd7fff700 1 -- 172.21.15.26:0/3604811998 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd80cffe0 con 0x7fafd80b55b0 2023-09-28T00:15:49.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd7fff700 1 --2- 172.21.15.26:0/3604811998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80b55b0 0x7fafd80ccbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009990 tx=0x7fafc0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f01aa0cb080e4c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd6ffd700 1 -- 172.21.15.26:0/3604811998 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0005c10 con 0x7fafd80b55b0 2023-09-28T00:15:49.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd6ffd700 1 -- 172.21.15.26:0/3604811998 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0005d70 con 0x7fafd80b55b0 2023-09-28T00:15:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.155+0000 7fafd6ffd700 1 -- 172.21.15.26:0/3604811998 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc000b8a0 con 0x7fafd80b55b0 2023-09-28T00:15:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.156+0000 7fafde963700 1 -- 172.21.15.26:0/3604811998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80b55b0 msgr2=0x7fafd80ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.156+0000 7fafde963700 1 --2- 172.21.15.26:0/3604811998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80b55b0 0x7fafd80ccbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009990 tx=0x7fafc0009220 comp rx=0 tx=0).stop 2023-09-28T00:15:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.156+0000 7fafde963700 1 -- 172.21.15.26:0/3604811998 shutdown_connections 2023-09-28T00:15:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.156+0000 7fafde963700 1 --2- 172.21.15.26:0/3604811998 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafd80d0f00 0x7fafd80ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.156+0000 7fafde963700 1 --2- 172.21.15.26:0/3604811998 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80b55b0 0x7fafd80ccbe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.156+0000 7fafde963700 1 -- 172.21.15.26:0/3604811998 >> 172.21.15.26:0/3604811998 conn(0x7fafd808a050 msgr2=0x7fafd8099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.156+0000 7fafde963700 1 -- 172.21.15.26:0/3604811998 shutdown_connections 2023-09-28T00:15:49.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.156+0000 7fafde963700 1 -- 172.21.15.26:0/3604811998 wait complete. 2023-09-28T00:15:49.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.157+0000 7fafde963700 1 Processor -- start 2023-09-28T00:15:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.157+0000 7fafde963700 1 -- start start 2023-09-28T00:15:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafde963700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fafd80b55b0 0x7fafd80c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafde963700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80cf800 0x7fafd815ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafde963700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafd80d0f00 0x7fafd80b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafde963700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd815bde0 con 0x7fafd80cf800 2023-09-28T00:15:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafde963700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd815b820 con 0x7fafd80b55b0 2023-09-28T00:15:49.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafde963700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd815bb00 con 0x7fafd80d0f00 2023-09-28T00:15:49.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafd77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80cf800 0x7fafd815ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafd77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80cf800 0x7fafd815ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40216/0 (socket says 172.21.15.26:40216) 2023-09-28T00:15:49.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafd77fe700 1 -- 172.21.15.26:0/1910515132 learned_addr learned my addr 172.21.15.26:0/1910515132 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:49.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafd7fff700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fafd80b55b0 0x7fafd80c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafdcf00700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafd80d0f00 0x7fafd80b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafd77fe700 1 -- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafd80d0f00 msgr2=0x7fafd80b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafd77fe700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fafd80d0f00 0x7fafd80b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafd77fe700 1 -- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fafd80b55b0 msgr2=0x7fafd80c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafd77fe700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fafd80b55b0 0x7fafd80c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.158+0000 7fafd77fe700 1 -- 172.21.15.26:0/1910515132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc0009480 con 0x7fafd80cf800 2023-09-28T00:15:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.159+0000 7fafd77fe700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80cf800 0x7fafd815ae60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fafc800c590 tx=0x7fafc800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.159+0000 7fafcffff700 1 -- 172.21.15.26:0/1910515132 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011590 con 0x7fafd80cf800 2023-09-28T00:15:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.159+0000 7fafcffff700 1 -- 172.21.15.26:0/1910515132 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc80116f0 con 0x7fafd80cf800 2023-09-28T00:15:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.159+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd80c7860 con 0x7fafd80cf800 2023-09-28T00:15:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.159+0000 7fafcffff700 1 -- 172.21.15.26:0/1910515132 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc8011ab0 con 0x7fafd80cf800 2023-09-28T00:15:49.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.159+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd80afef0 con 0x7fafd80cf800 2023-09-28T00:15:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.159+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafd80b0110 con 0x7fafd80cf800 2023-09-28T00:15:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.160+0000 7fafcffff700 1 -- 172.21.15.26:0/1910515132 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fafc801b3b0 con 0x7fafd80cf800 2023-09-28T00:15:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.161+0000 7fafcffff700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fafb8067330 0x7fafb80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.161+0000 7fafcffff700 1 -- 172.21.15.26:0/1910515132 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fafc8084890 con 0x7fafd80cf800 2023-09-28T00:15:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.161+0000 7fafcffff700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7fafb806fbe0 0x7fafb8071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.161+0000 7fafcffff700 1 -- 172.21.15.26:0/1910515132 --> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafb80726a0 con 0x7fafb806fbe0 2023-09-28T00:15:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.161+0000 7fafcffff700 1 -- 172.21.15.26:0/1910515132 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafc8084c60 con 0x7fafd80cf800 2023-09-28T00:15:49.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.161+0000 7fafd7fff700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fafb8067330 0x7fafb80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.161+0000 7fafdcf00700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7fafb806fbe0 0x7fafb8071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.161+0000 7fafdcf00700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7fafb806fbe0 0x7fafb8071ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.162+0000 7fafd7fff700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fafb8067330 0x7fafb80697e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fafc0007fd0 tx=0x7fafc0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.162+0000 7fafcffff700 1 -- 172.21.15.26:0/1910515132 <== osd.3 v2:172.21.15.26:6824/90242 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fafb80726a0 con 0x7fafb806fbe0 2023-09-28T00:15:49.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.176+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 --> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fafd815bf20 con 0x7fafb806fbe0 2023-09-28T00:15:49.177 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.176+0000 7fafcffff700 1 -- 172.21.15.26:0/1910515132 <== osd.3 v2:172.21.15.26:6824/90242 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fafd815bf20 con 0x7fafb806fbe0 2023-09-28T00:15:49.177 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-09-28T00:15:49.178 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:15:49.178 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-09-28T00:15:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.176+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7fafb806fbe0 msgr2=0x7fafb8071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.176+0000 7fafde963700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.26:6824/90242,v1:172.21.15.26:6825/90242] conn(0x7fafb806fbe0 0x7fafb8071ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.176+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fafb8067330 msgr2=0x7fafb80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.176+0000 7fafde963700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fafb8067330 0x7fafb80697e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fafc0007fd0 tx=0x7fafc0016000 comp rx=0 tx=0).stop 2023-09-28T00:15:49.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.176+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80cf800 msgr2=0x7fafd815ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.176+0000 7fafde963700 1 --2- 172.21.15.26:0/1910515132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafd80cf800 0x7fafd815ae60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fafc800c590 tx=0x7fafc800c950 comp rx=0 tx=0).stop 2023-09-28T00:15:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.176+0000 7fafdcf00700 1 -- 172.21.15.26:0/1910515132 reap_dead start 2023-09-28T00:15:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.177+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 shutdown_connections 2023-09-28T00:15:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.177+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 >> 172.21.15.26:0/1910515132 conn(0x7fafd808a050 msgr2=0x7fafd8158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.177+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 shutdown_connections 2023-09-28T00:15:49.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.177+0000 7fafde963700 1 -- 172.21.15.26:0/1910515132 wait complete. 2023-09-28T00:15:49.189 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-09-28T00:15:49.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.308+0000 7f0fda39f700 1 Processor -- start 2023-09-28T00:15:49.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.308+0000 7f0fda39f700 1 -- start start 2023-09-28T00:15:49.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.309+0000 7f0fda39f700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0fd4154110 0x7f0fd40c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.309+0000 7f0fda39f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 0x7f0fd4067b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.309+0000 7f0fda39f700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd415e310 con 0x7f0fd4153d40 2023-09-28T00:15:49.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.309+0000 7f0fda39f700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd40ca4d0 con 0x7f0fd4154110 2023-09-28T00:15:49.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.309+0000 7f0fda39f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd415d4b0 con 0x7f0fd40ca050 2023-09-28T00:15:49.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.309+0000 7f0fd8b9c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0fd4154110 0x7f0fd40c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.309+0000 7f0fd8b9c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0fd4154110 0x7f0fd40c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40230/0 (socket says 172.21.15.26:40230) 2023-09-28T00:15:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.309+0000 7f0fd8b9c700 1 -- 172.21.15.26:0/4223088872 learned_addr learned my addr 172.21.15.26:0/4223088872 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.309+0000 7f0fd9b9e700 1 --2- 172.21.15.26:0/4223088872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 0x7f0fd4067b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fd8b9c700 1 -- 172.21.15.26:0/4223088872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 msgr2=0x7f0fd4067b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fd8b9c700 1 --2- 172.21.15.26:0/4223088872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 0x7f0fd4067b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fd8b9c700 1 -- 172.21.15.26:0/4223088872 >> v1:172.21.15.190:6789/0 conn(0x7f0fd4153d40 legacy=0x7f0fd40aa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fd8b9c700 1 -- 172.21.15.26:0/4223088872 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd415d700 con 0x7f0fd4154110 2023-09-28T00:15:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fd9b9e700 1 --2- 172.21.15.26:0/4223088872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 0x7f0fd4067b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:15:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fd8b9c700 1 --2- 172.21.15.26:0/4223088872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 0x7f0fd40c9b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80099b0 tx=0x7f0fc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b009e391f2523ff7 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fd3fff700 1 -- 172.21.15.26:0/4223088872 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800b860 con 0x7f0fd4154110 2023-09-28T00:15:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fd3fff700 1 -- 172.21.15.26:0/4223088872 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc800b9c0 con 0x7f0fd4154110 2023-09-28T00:15:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fd3fff700 1 -- 172.21.15.26:0/4223088872 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc800bd60 con 0x7f0fd4154110 2023-09-28T00:15:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fda39f700 1 -- 172.21.15.26:0/4223088872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 msgr2=0x7f0fd40c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.310+0000 7f0fda39f700 1 --2- 172.21.15.26:0/4223088872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 0x7f0fd40c9b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80099b0 tx=0x7f0fc8009250 comp rx=0 tx=0).stop 2023-09-28T00:15:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.311+0000 7f0fda39f700 1 -- 172.21.15.26:0/4223088872 shutdown_connections 2023-09-28T00:15:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.311+0000 7f0fda39f700 1 --2- 172.21.15.26:0/4223088872 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 0x7f0fd4067b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.311+0000 7f0fda39f700 1 --2- 172.21.15.26:0/4223088872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 0x7f0fd40c9b10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.311+0000 7f0fda39f700 1 -- 172.21.15.26:0/4223088872 >> 172.21.15.26:0/4223088872 conn(0x7f0fd406a970 msgr2=0x7f0fd40c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.311+0000 7f0fda39f700 1 -- 172.21.15.26:0/4223088872 shutdown_connections 2023-09-28T00:15:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.311+0000 7f0fda39f700 1 -- 172.21.15.26:0/4223088872 wait complete. 2023-09-28T00:15:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.312+0000 7f0fda39f700 1 Processor -- start 2023-09-28T00:15:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.312+0000 7f0fda39f700 1 -- start start 2023-09-28T00:15:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fda39f700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 0x7f0fd40683e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fda39f700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd4153d40 0x7f0fd415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fda39f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 0x7f0fd414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fda39f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40ad5a0 con 0x7f0fd4154110 2023-09-28T00:15:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fda39f700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40acd00 con 0x7f0fd4153d40 2023-09-28T00:15:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fda39f700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd40acfe0 con 0x7f0fd40ca050 2023-09-28T00:15:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd9b9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 0x7f0fd414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd9b9e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 0x7f0fd414ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40236/0 (socket says 172.21.15.26:40236) 2023-09-28T00:15:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd9b9e700 1 -- 172.21.15.26:0/1066402121 learned_addr learned my addr 172.21.15.26:0/1066402121 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd939d700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 0x7f0fd40683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd8b9c700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd4153d40 0x7f0fd415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd9b9e700 1 -- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 msgr2=0x7f0fd40683e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd9b9e700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 0x7f0fd40683e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd9b9e700 1 -- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd4153d40 msgr2=0x7f0fd415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd9b9e700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd4153d40 0x7f0fd415a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd9b9e700 1 -- 172.21.15.26:0/1066402121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc80094f0 con 0x7f0fd4154110 2023-09-28T00:15:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd9b9e700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 0x7f0fd414ccb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009fc0 tx=0x7f0fc40099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd17fa700 1 -- 172.21.15.26:0/1066402121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc400dbe0 con 0x7f0fd4154110 2023-09-28T00:15:49.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd17fa700 1 -- 172.21.15.26:0/1066402121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc400f040 con 0x7f0fd4154110 2023-09-28T00:15:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd40ad2c0 con 0x7f0fd4154110 2023-09-28T00:15:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fd17fa700 1 -- 172.21.15.26:0/1066402121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4015440 con 0x7f0fd4154110 2023-09-28T00:15:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.313+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd40ac9d0 con 0x7f0fd4154110 2023-09-28T00:15:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.314+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd415b320 con 0x7f0fd4154110 2023-09-28T00:15:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.315+0000 7f0fd17fa700 1 -- 172.21.15.26:0/1066402121 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0fc401e3b0 con 0x7f0fd4154110 2023-09-28T00:15:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.315+0000 7f0fd17fa700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0fc0067330 0x7f0fc00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.315+0000 7f0fd17fa700 1 -- 172.21.15.26:0/1066402121 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0fc4085060 con 0x7f0fd4154110 2023-09-28T00:15:49.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.315+0000 7f0fd939d700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0fc0067330 0x7f0fc00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.316+0000 7f0fd939d700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0fc0067330 0x7f0fc00697e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0fd416d0f0 tx=0x7f0fcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.319+0000 7f0fd17fa700 1 -- 172.21.15.26:0/1066402121 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0fd415b320 con 0x7f0fd4154110 2023-09-28T00:15:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.512+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fd415b700 con 0x7f0fc0067330 2023-09-28T00:15:49.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.513+0000 7f0fd17fa700 1 -- 172.21.15.26:0/1066402121 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0fd415b700 con 0x7f0fc0067330 2023-09-28T00:15:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0fc0067330 msgr2=0x7f0fc00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0fc0067330 0x7f0fc00697e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0fd416d0f0 tx=0x7f0fcc009040 comp rx=0 tx=0).stop 2023-09-28T00:15:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 msgr2=0x7f0fd414ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 0x7f0fd414ccb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009fc0 tx=0x7f0fc40099b0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 shutdown_connections 2023-09-28T00:15:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0fc0067330 0x7f0fc00697e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0fd40ca050 0x7f0fd40683e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0fd4154110 0x7f0fd414ccb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 --2- 172.21.15.26:0/1066402121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0fd4153d40 0x7f0fd415a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 >> 172.21.15.26:0/1066402121 conn(0x7f0fd406a970 msgr2=0x7f0fd40692e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 shutdown_connections 2023-09-28T00:15:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.515+0000 7f0fda39f700 1 -- 172.21.15.26:0/1066402121 wait complete. 2023-09-28T00:15:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 3 to deep-scrub 2023-09-28T00:15:49.528 INFO:tasks.ceph:Scrubbing osd.4 2023-09-28T00:15:49.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:15:49.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.649+0000 7fe2ba07c700 1 Processor -- start 2023-09-28T00:15:49.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.649+0000 7fe2ba07c700 1 -- start start 2023-09-28T00:15:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.650+0000 7fe2ba07c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2b40b55b0 0x7fe2b40ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.650+0000 7fe2ba07c700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe2b40cf800 0x7fe2b40b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.650+0000 7fe2ba07c700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b40cbed0 con 0x7fe2b40d0f00 2023-09-28T00:15:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.650+0000 7fe2ba07c700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b4159d40 con 0x7fe2b40b55b0 2023-09-28T00:15:49.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.650+0000 7fe2ba07c700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b40cc750 con 0x7fe2b40cf800 2023-09-28T00:15:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.650+0000 7fe2b37fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2b40b55b0 0x7fe2b40ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.650+0000 7fe2b3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe2b40d0f00 0x7fe2b40ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49286/0 (socket says 172.21.15.26:49286) 2023-09-28T00:15:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.650+0000 7fe2b3fff700 1 -- 172.21.15.26:0/1742733619 learned_addr learned my addr 172.21.15.26:0/1742733619 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b2ffd700 1 --2- 172.21.15.26:0/1742733619 >> v2:172.21.15.190:3300/0 conn(0x7fe2b40cf800 0x7fe2b40b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b37fe700 1 -- 172.21.15.26:0/1742733619 >> v2:172.21.15.190:3300/0 conn(0x7fe2b40cf800 msgr2=0x7fe2b40b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b37fe700 1 --2- 172.21.15.26:0/1742733619 >> v2:172.21.15.190:3300/0 conn(0x7fe2b40cf800 0x7fe2b40b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b37fe700 1 -- 172.21.15.26:0/1742733619 >> v1:172.21.15.26:6789/0 conn(0x7fe2b40d0f00 legacy=0x7fe2b40ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b27fc700 1 -- 172.21.15.26:0/1742733619 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970659483 0 0) 0x7fe2b40cbed0 con 0x7fe2b40d0f00 2023-09-28T00:15:49.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b37fe700 1 -- 172.21.15.26:0/1742733619 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40b5ec0 con 0x7fe2b40b55b0 2023-09-28T00:15:49.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b37fe700 1 --2- 172.21.15.26:0/1742733619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40b55b0 0x7fe2b40ccbe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40b66a0 tx=0x7fe2a4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1bd82dcdac1ae64 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b27fc700 1 -- 172.21.15.26:0/1742733619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4005c10 con 0x7fe2b40b55b0 2023-09-28T00:15:49.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b27fc700 1 -- 172.21.15.26:0/1742733619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4005d70 con 0x7fe2b40b55b0 2023-09-28T00:15:49.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.651+0000 7fe2b27fc700 1 -- 172.21.15.26:0/1742733619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4006280 con 0x7fe2b40b55b0 2023-09-28T00:15:49.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.652+0000 7fe2ba07c700 1 -- 172.21.15.26:0/1742733619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40b55b0 msgr2=0x7fe2b40ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.652+0000 7fe2ba07c700 1 --2- 172.21.15.26:0/1742733619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40b55b0 0x7fe2b40ccbe0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40b66a0 tx=0x7fe2a4009120 comp rx=0 tx=0).stop 2023-09-28T00:15:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.652+0000 7fe2ba07c700 1 -- 172.21.15.26:0/1742733619 shutdown_connections 2023-09-28T00:15:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.652+0000 7fe2ba07c700 1 --2- 172.21.15.26:0/1742733619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40b55b0 0x7fe2b40ccbe0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.652+0000 7fe2ba07c700 1 --2- 172.21.15.26:0/1742733619 >> v2:172.21.15.190:3300/0 conn(0x7fe2b40cf800 0x7fe2b40b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.652+0000 7fe2ba07c700 1 -- 172.21.15.26:0/1742733619 >> 172.21.15.26:0/1742733619 conn(0x7fe2b408a050 msgr2=0x7fe2b4099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.652+0000 7fe2ba07c700 1 -- 172.21.15.26:0/1742733619 shutdown_connections 2023-09-28T00:15:49.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.652+0000 7fe2ba07c700 1 -- 172.21.15.26:0/1742733619 wait complete. 2023-09-28T00:15:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.653+0000 7fe2ba07c700 1 Processor -- start 2023-09-28T00:15:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.653+0000 7fe2ba07c700 1 -- start start 2023-09-28T00:15:49.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2ba07c700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2b40b55b0 0x7fe2b40c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2ba07c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40cf800 0x7fe2b415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2ba07c700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b40d0f00 0x7fe2b415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2ba07c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b415c240 con 0x7fe2b40cf800 2023-09-28T00:15:49.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2ba07c700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b406b030 con 0x7fe2b40d0f00 2023-09-28T00:15:49.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2ba07c700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b416a760 con 0x7fe2b40b55b0 2023-09-28T00:15:49.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40cf800 0x7fe2b415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40cf800 0x7fe2b415e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40256/0 (socket says 172.21.15.26:40256) 2023-09-28T00:15:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b2ffd700 1 -- 172.21.15.26:0/2423559984 learned_addr learned my addr 172.21.15.26:0/2423559984 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b3fff700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b40d0f00 0x7fe2b415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b37fe700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2b40b55b0 0x7fe2b40c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b2ffd700 1 -- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2b40b55b0 msgr2=0x7fe2b40c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b2ffd700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2b40b55b0 0x7fe2b40c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b2ffd700 1 -- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b40d0f00 msgr2=0x7fe2b415c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b2ffd700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2b40d0f00 0x7fe2b415c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b2ffd700 1 -- 172.21.15.26:0/2423559984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a40093c0 con 0x7fe2b40cf800 2023-09-28T00:15:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2b2ffd700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40cf800 0x7fe2b415e9d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800ec80 tx=0x7fe2a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe29b7fe700 1 -- 172.21.15.26:0/2423559984 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800c9d0 con 0x7fe2b40cf800 2023-09-28T00:15:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe29b7fe700 1 -- 172.21.15.26:0/2423559984 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a800cb50 con 0x7fe2b40cf800 2023-09-28T00:15:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.654+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b416a9e0 con 0x7fe2b40cf800 2023-09-28T00:15:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.655+0000 7fe29b7fe700 1 -- 172.21.15.26:0/2423559984 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8013470 con 0x7fe2b40cf800 2023-09-28T00:15:49.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.655+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b416ae70 con 0x7fe2b40cf800 2023-09-28T00:15:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.655+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2b40717c0 con 0x7fe2b40cf800 2023-09-28T00:15:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.656+0000 7fe29b7fe700 1 -- 172.21.15.26:0/2423559984 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe2a8013820 con 0x7fe2b40cf800 2023-09-28T00:15:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.656+0000 7fe29b7fe700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe2a0067330 0x7fe2a00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.656+0000 7fe29b7fe700 1 -- 172.21.15.26:0/2423559984 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2a8085360 con 0x7fe2b40cf800 2023-09-28T00:15:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.656+0000 7fe29b7fe700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7fe2a006fbe0 0x7fe2a0071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.656+0000 7fe29b7fe700 1 -- 172.21.15.26:0/2423559984 --> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2a00726a0 con 0x7fe2a006fbe0 2023-09-28T00:15:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.656+0000 7fe29b7fe700 1 -- 172.21.15.26:0/2423559984 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2a8085730 con 0x7fe2b40cf800 2023-09-28T00:15:49.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.657+0000 7fe2b37fe700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe2a0067330 0x7fe2a00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.657+0000 7fe2b3fff700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7fe2a006fbe0 0x7fe2a0071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.657+0000 7fe2b37fe700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe2a0067330 0x7fe2a00697e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400a010 tx=0x7fe2a4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.657+0000 7fe2b3fff700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7fe2a006fbe0 0x7fe2a0071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.658+0000 7fe29b7fe700 1 -- 172.21.15.26:0/2423559984 <== osd.4 v2:172.21.15.190:6800/90454 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe2a00726a0 con 0x7fe2a006fbe0 2023-09-28T00:15:49.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.672+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 --> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe2b40cffe0 con 0x7fe2a006fbe0 2023-09-28T00:15:49.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe29b7fe700 1 -- 172.21.15.26:0/2423559984 <== osd.4 v2:172.21.15.190:6800/90454 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe2b40cffe0 con 0x7fe2a006fbe0 2023-09-28T00:15:49.674 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-09-28T00:15:49.674 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:15:49.674 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-09-28T00:15:49.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7fe2a006fbe0 msgr2=0x7fe2a0071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6800/90454,v1:172.21.15.190:6801/90454] conn(0x7fe2a006fbe0 0x7fe2a0071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe2a0067330 msgr2=0x7fe2a00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe2a0067330 0x7fe2a00697e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400a010 tx=0x7fe2a4016000 comp rx=0 tx=0).stop 2023-09-28T00:15:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40cf800 msgr2=0x7fe2b415e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 --2- 172.21.15.26:0/2423559984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2b40cf800 0x7fe2b415e9d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800ec80 tx=0x7fe2a80091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2b3fff700 1 -- 172.21.15.26:0/2423559984 reap_dead start 2023-09-28T00:15:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 shutdown_connections 2023-09-28T00:15:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 >> 172.21.15.26:0/2423559984 conn(0x7fe2b408a050 msgr2=0x7fe2b4158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 shutdown_connections 2023-09-28T00:15:49.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.673+0000 7fe2ba07c700 1 -- 172.21.15.26:0/2423559984 wait complete. 2023-09-28T00:15:49.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-09-28T00:15:49.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.804+0000 7f0ab8905700 1 Processor -- start 2023-09-28T00:15:49.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.804+0000 7f0ab8905700 1 -- start start 2023-09-28T00:15:49.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.805+0000 7f0ab8905700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab415dab0 0x7f0ab40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.805+0000 7f0ab8905700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab40b1110 con 0x7f0ab41598d0 2023-09-28T00:15:49.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.805+0000 7f0ab8905700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab40b13b0 con 0x7f0ab4159500 2023-09-28T00:15:49.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.805+0000 7f0ab8905700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40b1690 con 0x7f0ab415dab0 2023-09-28T00:15:49.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.805+0000 7f0ab1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0ab41598d0 0x7f0ab415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49302/0 (socket says 172.21.15.26:49302) 2023-09-28T00:15:49.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.805+0000 7f0ab1d9b700 1 -- 172.21.15.26:0/717792038 learned_addr learned my addr 172.21.15.26:0/717792038 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:49.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.805+0000 7f0ab2d9d700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab415dab0 0x7f0ab40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226590982 0 0) 0x7f0ab40b1110 con 0x7f0ab41598d0 2023-09-28T00:15:49.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa0003570 con 0x7f0ab41598d0 2023-09-28T00:15:49.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937110202 0 0) 0x7f0ab40b13b0 con 0x7f0ab4159500 2023-09-28T00:15:49.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ab40b1110 con 0x7f0ab4159500 2023-09-28T00:15:49.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 615167071 0 0) 0x7f0aa0003570 con 0x7f0ab41598d0 2023-09-28T00:15:49.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab415dab0 msgr2=0x7f0ab40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:49.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab415dab0 0x7f0ab40cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 >> v1:172.21.15.190:6789/0 conn(0x7f0ab4159500 legacy=0x7f0ab40b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab40b1970 con 0x7f0ab41598d0 2023-09-28T00:15:49.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7f0a9c001470 con 0x7f0ab41598d0 2023-09-28T00:15:49.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 >> v1:172.21.15.26:6789/0 conn(0x7f0ab41598d0 legacy=0x7f0ab415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aa0003c20 0x7f0aa0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa0004810 0x7f0aa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab415dab0 0x7f0aa0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40b1690 con 0x7f0aa0003c20 2023-09-28T00:15:49.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa000bbf0 con 0x7f0aa0004810 2023-09-28T00:15:49.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa000bdb0 con 0x7f0ab415dab0 2023-09-28T00:15:49.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab259c700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aa0003c20 0x7f0aa0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab1d9b700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa0004810 0x7f0aa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab2d9d700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab415dab0 0x7f0aa0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab259c700 1 -- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab415dab0 msgr2=0x7f0aa0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:49.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab259c700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab415dab0 0x7f0aa0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab259c700 1 -- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa0004810 msgr2=0x7f0aa0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:49.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab259c700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa0004810 0x7f0aa0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab259c700 1 -- 172.21.15.26:0/717792038 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0003570 con 0x7f0aa0003c20 2023-09-28T00:15:49.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.806+0000 7f0ab259c700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aa0003c20 0x7f0aa0004010 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0aac001a10 tx=0x7f0aac007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1285ec19e287e22b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00c5d0 con 0x7f0aa0003c20 2023-09-28T00:15:49.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac00c730 con 0x7f0aa0003c20 2023-09-28T00:15:49.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab159a700 1 -- 172.21.15.26:0/717792038 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00cad0 con 0x7f0aa0003c20 2023-09-28T00:15:49.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab8905700 1 -- 172.21.15.26:0/717792038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aa0003c20 msgr2=0x7f0aa0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab8905700 1 --2- 172.21.15.26:0/717792038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aa0003c20 0x7f0aa0004010 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0aac001a10 tx=0x7f0aac007d30 comp rx=0 tx=0).stop 2023-09-28T00:15:49.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab2d9d700 1 -- 172.21.15.26:0/717792038 reap_dead start 2023-09-28T00:15:49.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab8905700 1 -- 172.21.15.26:0/717792038 shutdown_connections 2023-09-28T00:15:49.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab8905700 1 -- 172.21.15.26:0/717792038 >> 172.21.15.26:0/717792038 conn(0x7f0ab4067630 msgr2=0x7f0ab4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:49.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab8905700 1 -- 172.21.15.26:0/717792038 shutdown_connections 2023-09-28T00:15:49.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.807+0000 7f0ab8905700 1 -- 172.21.15.26:0/717792038 wait complete. 2023-09-28T00:15:49.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.808+0000 7f0ab8905700 1 Processor -- start 2023-09-28T00:15:49.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.808+0000 7f0ab8905700 1 -- start start 2023-09-28T00:15:49.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab8905700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa0003c20 0x7f0ab415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab8905700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab40ae910 0x7f0ab415a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab8905700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab4158270 0x7f0ab41586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab8905700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40a8c40 con 0x7f0ab40ae910 2023-09-28T00:15:49.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab8905700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab415c7a0 con 0x7f0aa0003c20 2023-09-28T00:15:49.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab8905700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab4158be0 con 0x7f0ab4158270 2023-09-28T00:15:49.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab40ae910 0x7f0ab415a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab1d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab40ae910 0x7f0ab415a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40266/0 (socket says 172.21.15.26:40266) 2023-09-28T00:15:49.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab1d9b700 1 -- 172.21.15.26:0/3453986085 learned_addr learned my addr 172.21.15.26:0/3453986085 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:49.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab259c700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa0003c20 0x7f0ab415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.809+0000 7f0ab2d9d700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab4158270 0x7f0ab41586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0ab1d9b700 1 -- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab4158270 msgr2=0x7f0ab41586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0ab1d9b700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab4158270 0x7f0ab41586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0ab1d9b700 1 -- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa0003c20 msgr2=0x7f0ab415cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:49.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0ab1d9b700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa0003c20 0x7f0ab415cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:49.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0ab1d9b700 1 -- 172.21.15.26:0/3453986085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab415acd0 con 0x7f0ab40ae910 2023-09-28T00:15:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0ab1d9b700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab40ae910 0x7f0ab415a790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c007310 tx=0x7f0ab415e380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0aaa7fc700 1 -- 172.21.15.26:0/3453986085 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c0115c0 con 0x7f0ab40ae910 2023-09-28T00:15:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0aaa7fc700 1 -- 172.21.15.26:0/3453986085 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c011720 con 0x7f0ab40ae910 2023-09-28T00:15:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab415b8b0 con 0x7f0ab40ae910 2023-09-28T00:15:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0aaa7fc700 1 -- 172.21.15.26:0/3453986085 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c011ae0 con 0x7f0ab40ae910 2023-09-28T00:15:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.810+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab415be70 con 0x7f0ab40ae910 2023-09-28T00:15:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.811+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab415c950 con 0x7f0ab40ae910 2023-09-28T00:15:49.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.811+0000 7f0aaa7fc700 1 -- 172.21.15.26:0/3453986085 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f0a9c01d3b0 con 0x7f0ab40ae910 2023-09-28T00:15:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.812+0000 7f0aaa7fc700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0a94067330 0x7f0a940697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.812+0000 7f0aaa7fc700 1 -- 172.21.15.26:0/3453986085 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a9c0847e0 con 0x7f0ab40ae910 2023-09-28T00:15:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.812+0000 7f0ab259c700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0a94067330 0x7f0a940697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.813+0000 7f0ab259c700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0a94067330 0x7f0a940697e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:49.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:49.816+0000 7f0aaa7fc700 1 -- 172.21.15.26:0/3453986085 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f0ab415c950 con 0x7f0ab40ae910 2023-09-28T00:15:50.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.015+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ab415c950 con 0x7f0a94067330 2023-09-28T00:15:50.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.015+0000 7f0aaa7fc700 1 -- 172.21.15.26:0/3453986085 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0ab415c950 con 0x7f0a94067330 2023-09-28T00:15:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0a94067330 msgr2=0x7f0a940697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0a94067330 0x7f0a940697e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000c00 tx=0x7f0aac015000 comp rx=0 tx=0).stop 2023-09-28T00:15:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab40ae910 msgr2=0x7f0ab415a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab40ae910 0x7f0ab415a790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c007310 tx=0x7f0ab415e380 comp rx=0 tx=0).stop 2023-09-28T00:15:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 shutdown_connections 2023-09-28T00:15:50.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f0a94067330 0x7f0a940697e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0ab4158270 0x7f0ab41586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0aa0003c20 0x7f0ab415cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 --2- 172.21.15.26:0/3453986085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ab40ae910 0x7f0ab415a790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 >> 172.21.15.26:0/3453986085 conn(0x7f0ab4067630 msgr2=0x7f0ab40ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 shutdown_connections 2023-09-28T00:15:50.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.018+0000 7f0ab8905700 1 -- 172.21.15.26:0/3453986085 wait complete. 2023-09-28T00:15:50.021 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 4 to deep-scrub 2023-09-28T00:15:50.031 INFO:tasks.ceph:Scrubbing osd.5 2023-09-28T00:15:50.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:15:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.153+0000 7f7832e76700 1 Processor -- start 2023-09-28T00:15:50.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.153+0000 7f7832e76700 1 -- start start 2023-09-28T00:15:50.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7832e76700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f782c0cc850 0x7f782c0cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7832e76700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0cb670 con 0x7f782c0cf810 2023-09-28T00:15:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7832e76700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0cce90 con 0x7f782c0cf440 2023-09-28T00:15:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7832e76700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0cccb0 con 0x7f782c0cc850 2023-09-28T00:15:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7832675700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f782c0cc850 0x7f782c0cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7831673700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f782c0cf810 0x7f782c158e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49304/0 (socket says 172.21.15.26:49304) 2023-09-28T00:15:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7831673700 1 -- 172.21.15.26:0/1417609296 learned_addr learned my addr 172.21.15.26:0/1417609296 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:50.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7832675700 1 -- 172.21.15.26:0/1417609296 >> v1:172.21.15.190:6789/0 conn(0x7f782c0cf440 legacy=0x7f782c0cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7832675700 1 -- 172.21.15.26:0/1417609296 >> v1:172.21.15.26:6789/0 conn(0x7f782c0cf810 legacy=0x7f782c158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7832675700 1 -- 172.21.15.26:0/1417609296 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0cad80 con 0x7f782c0cc850 2023-09-28T00:15:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7830e72700 1 -- 172.21.15.26:0/1417609296 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255636964 0 0) 0x7f782c0cb670 con 0x7f782c0cf810 2023-09-28T00:15:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.154+0000 7f7832675700 1 --2- 172.21.15.26:0/1417609296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cc850 0x7f782c0cbb00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f781c009e60 tx=0x7f781c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2555f861c92e908 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7830e72700 1 -- 172.21.15.26:0/1417609296 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c00e070 con 0x7f782c0cc850 2023-09-28T00:15:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7830e72700 1 -- 172.21.15.26:0/1417609296 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c00bc30 con 0x7f782c0cc850 2023-09-28T00:15:50.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7830e72700 1 -- 172.21.15.26:0/1417609296 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c012430 con 0x7f782c0cc850 2023-09-28T00:15:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7832e76700 1 -- 172.21.15.26:0/1417609296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cc850 msgr2=0x7f782c0cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7832e76700 1 --2- 172.21.15.26:0/1417609296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cc850 0x7f782c0cbb00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f781c009e60 tx=0x7f781c009780 comp rx=0 tx=0).stop 2023-09-28T00:15:50.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7832e76700 1 -- 172.21.15.26:0/1417609296 shutdown_connections 2023-09-28T00:15:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7832e76700 1 --2- 172.21.15.26:0/1417609296 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cc850 0x7f782c0cbb00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7832e76700 1 -- 172.21.15.26:0/1417609296 >> 172.21.15.26:0/1417609296 conn(0x7f782c0cd080 msgr2=0x7f782c0cd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7832e76700 1 -- 172.21.15.26:0/1417609296 shutdown_connections 2023-09-28T00:15:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.155+0000 7f7832e76700 1 -- 172.21.15.26:0/1417609296 wait complete. 2023-09-28T00:15:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.156+0000 7f7832e76700 1 Processor -- start 2023-09-28T00:15:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.156+0000 7f7832e76700 1 -- start start 2023-09-28T00:15:50.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7832e76700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f782c0cc850 0x7f782c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7832e76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cf440 0x7f782c1491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7832e76700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f782c0cf810 0x7f782c15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7832e76700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c15e790 con 0x7f782c0cf440 2023-09-28T00:15:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7832e76700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c15d920 con 0x7f782c0cf810 2023-09-28T00:15:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7832e76700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c15db80 con 0x7f782c0cc850 2023-09-28T00:15:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7831673700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cf440 0x7f782c1491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7831673700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cf440 0x7f782c1491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40280/0 (socket says 172.21.15.26:40280) 2023-09-28T00:15:50.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7831673700 1 -- 172.21.15.26:0/2876647947 learned_addr learned my addr 172.21.15.26:0/2876647947 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7832675700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f782c0cf810 0x7f782c15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7831e74700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f782c0cc850 0x7f782c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7831673700 1 -- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f782c0cc850 msgr2=0x7f782c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7831673700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f782c0cc850 0x7f782c15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7831673700 1 -- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f782c0cf810 msgr2=0x7f782c15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7831673700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f782c0cf810 0x7f782c15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.157+0000 7f7831673700 1 -- 172.21.15.26:0/2876647947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c009a20 con 0x7f782c0cf440 2023-09-28T00:15:50.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.158+0000 7f7831673700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cf440 0x7f782c1491c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f782000c5b0 tx=0x7f7820001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.158+0000 7f7829ffb700 1 -- 172.21.15.26:0/2876647947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820005b30 con 0x7f782c0cf440 2023-09-28T00:15:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.158+0000 7f7829ffb700 1 -- 172.21.15.26:0/2876647947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7820005c90 con 0x7f782c0cf440 2023-09-28T00:15:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.158+0000 7f7829ffb700 1 -- 172.21.15.26:0/2876647947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820007300 con 0x7f782c0cf440 2023-09-28T00:15:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.158+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c15de60 con 0x7f782c0cf440 2023-09-28T00:15:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.158+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c15e420 con 0x7f782c0cf440 2023-09-28T00:15:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.159+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f782c064050 con 0x7f782c0cf440 2023-09-28T00:15:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.159+0000 7f7829ffb700 1 -- 172.21.15.26:0/2876647947 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f782001b3b0 con 0x7f782c0cf440 2023-09-28T00:15:50.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.159+0000 7f7829ffb700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7818067330 0x7f78180697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.160+0000 7f7829ffb700 1 -- 172.21.15.26:0/2876647947 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7820084170 con 0x7f782c0cf440 2023-09-28T00:15:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.160+0000 7f7829ffb700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f781806fbe0 0x7f7818071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.160+0000 7f7829ffb700 1 -- 172.21.15.26:0/2876647947 --> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78180726a0 con 0x7f781806fbe0 2023-09-28T00:15:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.160+0000 7f7831e74700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7818067330 0x7f78180697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.160+0000 7f7829ffb700 1 -- 172.21.15.26:0/2876647947 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78200866d0 con 0x7f782c0cf440 2023-09-28T00:15:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.160+0000 7f7832675700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f781806fbe0 0x7f7818071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.160+0000 7f7831e74700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7818067330 0x7f78180697e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7824003860 tx=0x7f7824009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.160+0000 7f7832675700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f781806fbe0 0x7f7818071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.161+0000 7f7829ffb700 1 -- 172.21.15.26:0/2876647947 <== osd.5 v2:172.21.15.190:6816/90467 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f78180726a0 con 0x7f781806fbe0 2023-09-28T00:15:50.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.175+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 --> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f782c0cff30 con 0x7f781806fbe0 2023-09-28T00:15:50.176 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.175+0000 7f7829ffb700 1 -- 172.21.15.26:0/2876647947 <== osd.5 v2:172.21.15.190:6816/90467 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f782c0cff30 con 0x7f781806fbe0 2023-09-28T00:15:50.176 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-09-28T00:15:50.177 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:15:50.177 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-09-28T00:15:50.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f781806fbe0 msgr2=0x7f7818071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6816/90467,v1:172.21.15.190:6817/90467] conn(0x7f781806fbe0 0x7f7818071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7818067330 msgr2=0x7f78180697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f7818067330 0x7f78180697e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7824003860 tx=0x7f7824009040 comp rx=0 tx=0).stop 2023-09-28T00:15:50.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cf440 msgr2=0x7f782c1491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 --2- 172.21.15.26:0/2876647947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f782c0cf440 0x7f782c1491c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f782000c5b0 tx=0x7f7820001070 comp rx=0 tx=0).stop 2023-09-28T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832675700 1 -- 172.21.15.26:0/2876647947 reap_dead start 2023-09-28T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 shutdown_connections 2023-09-28T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 >> 172.21.15.26:0/2876647947 conn(0x7f782c0cd080 msgr2=0x7f782c0b0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 shutdown_connections 2023-09-28T00:15:50.179 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.176+0000 7f7832e76700 1 -- 172.21.15.26:0/2876647947 wait complete. 2023-09-28T00:15:50.188 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-09-28T00:15:50.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.307+0000 7efcdd7e4700 1 Processor -- start 2023-09-28T00:15:50.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.307+0000 7efcdd7e4700 1 -- start start 2023-09-28T00:15:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcdd7e4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd8159500 0x7efcd81598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcdd7e4700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efcd80b3fd0 0x7efcd815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcdd7e4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd815dd20 con 0x7efcd815d8e0 2023-09-28T00:15:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcdd7e4700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd80b1110 con 0x7efcd80b3fd0 2023-09-28T00:15:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcdd7e4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80b13b0 con 0x7efcd8159500 2023-09-28T00:15:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd77fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efcd815d8e0 0x7efcd80cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49316/0 (socket says 172.21.15.26:49316) 2023-09-28T00:15:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd77fe700 1 -- 172.21.15.26:0/346521753 learned_addr learned my addr 172.21.15.26:0/346521753 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd6ffd700 1 --2- 172.21.15.26:0/346521753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd8159500 0x7efcd81598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd67fc700 1 --2- 172.21.15.26:0/346521753 >> v2:172.21.15.190:3300/0 conn(0x7efcd80b3fd0 0x7efcd815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd5ffb700 1 -- 172.21.15.26:0/346521753 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853700506 0 0) 0x7efcd815dd20 con 0x7efcd815d8e0 2023-09-28T00:15:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd5ffb700 1 -- 172.21.15.26:0/346521753 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc0003570 con 0x7efcd815d8e0 2023-09-28T00:15:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd67fc700 1 -- 172.21.15.26:0/346521753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd8159500 msgr2=0x7efcd81598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd67fc700 1 --2- 172.21.15.26:0/346521753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd8159500 0x7efcd81598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd67fc700 1 -- 172.21.15.26:0/346521753 >> v1:172.21.15.26:6789/0 conn(0x7efcd815d8e0 legacy=0x7efcd80cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd67fc700 1 -- 172.21.15.26:0/346521753 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80b1690 con 0x7efcd80b3fd0 2023-09-28T00:15:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd6ffd700 1 --2- 172.21.15.26:0/346521753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd8159500 0x7efcd81598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.308+0000 7efcd67fc700 1 --2- 172.21.15.26:0/346521753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcd80b3fd0 0x7efcd815d3a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098e0 tx=0x7efccc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=865f76a0b14ec145 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcd5ffb700 1 -- 172.21.15.26:0/346521753 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc011630 con 0x7efcd80b3fd0 2023-09-28T00:15:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcd5ffb700 1 -- 172.21.15.26:0/346521753 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efccc011790 con 0x7efcd80b3fd0 2023-09-28T00:15:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcd5ffb700 1 -- 172.21.15.26:0/346521753 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc011b30 con 0x7efcd80b3fd0 2023-09-28T00:15:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcdd7e4700 1 -- 172.21.15.26:0/346521753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcd80b3fd0 msgr2=0x7efcd815d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcdd7e4700 1 --2- 172.21.15.26:0/346521753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcd80b3fd0 0x7efcd815d3a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efccc0098e0 tx=0x7efccc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcdd7e4700 1 -- 172.21.15.26:0/346521753 shutdown_connections 2023-09-28T00:15:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcdd7e4700 1 --2- 172.21.15.26:0/346521753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd8159500 0x7efcd81598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcdd7e4700 1 --2- 172.21.15.26:0/346521753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcd80b3fd0 0x7efcd815d3a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcdd7e4700 1 -- 172.21.15.26:0/346521753 >> 172.21.15.26:0/346521753 conn(0x7efcd8067630 msgr2=0x7efcd8069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:50.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcdd7e4700 1 -- 172.21.15.26:0/346521753 shutdown_connections 2023-09-28T00:15:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.309+0000 7efcdd7e4700 1 -- 172.21.15.26:0/346521753 wait complete. 2023-09-28T00:15:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcdd7e4700 1 Processor -- start 2023-09-28T00:15:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcdd7e4700 1 -- start start 2023-09-28T00:15:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcdd7e4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd80b3fd0 0x7efcd815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcdd7e4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcd8159500 0x7efcd8169a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcdd7e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcd815d8e0 0x7efcd816ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcdd7e4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8169f70 con 0x7efcd815d8e0 2023-09-28T00:15:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcdd7e4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd816b050 con 0x7efcd8159500 2023-09-28T00:15:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcdd7e4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd815bc90 con 0x7efcd80b3fd0 2023-09-28T00:15:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcd77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcd815d8e0 0x7efcd816ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcd77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcd815d8e0 0x7efcd816ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40286/0 (socket says 172.21.15.26:40286) 2023-09-28T00:15:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.311+0000 7efcd77fe700 1 -- 172.21.15.26:0/3430794663 learned_addr learned my addr 172.21.15.26:0/3430794663 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:50.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcd6ffd700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd80b3fd0 0x7efcd815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcd67fc700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcd8159500 0x7efcd8169a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcd77fe700 1 -- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd80b3fd0 msgr2=0x7efcd815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcd77fe700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd80b3fd0 0x7efcd815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcd77fe700 1 -- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcd8159500 msgr2=0x7efcd8169a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcd77fe700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcd8159500 0x7efcd8169a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcd77fe700 1 -- 172.21.15.26:0/3430794663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc8009420 con 0x7efcd815d8e0 2023-09-28T00:15:50.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcd77fe700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcd815d8e0 0x7efcd816ab10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efcd0001460 tx=0x7efcd0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcbeffd700 1 -- 172.21.15.26:0/3430794663 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000a8a0 con 0x7efcd815d8e0 2023-09-28T00:15:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcbeffd700 1 -- 172.21.15.26:0/3430794663 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd000aa00 con 0x7efcd815d8e0 2023-09-28T00:15:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efccc009420 con 0x7efcd815d8e0 2023-09-28T00:15:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcbeffd700 1 -- 172.21.15.26:0/3430794663 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd000ad80 con 0x7efcd815d8e0 2023-09-28T00:15:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.312+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd815c250 con 0x7efcd815d8e0 2023-09-28T00:15:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.313+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd81568e0 con 0x7efcd815d8e0 2023-09-28T00:15:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.314+0000 7efcbeffd700 1 -- 172.21.15.26:0/3430794663 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7efcd0007300 con 0x7efcd815d8e0 2023-09-28T00:15:50.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.315+0000 7efcbeffd700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efcc4067330 0x7efcc40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.315+0000 7efcbeffd700 1 -- 172.21.15.26:0/3430794663 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efcd0085a90 con 0x7efcd815d8e0 2023-09-28T00:15:50.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.315+0000 7efcd6ffd700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efcc4067330 0x7efcc40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.315+0000 7efcd6ffd700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efcc4067330 0x7efcc40697e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009f40 tx=0x7efcc80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.318+0000 7efcbeffd700 1 -- 172.21.15.26:0/3430794663 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7efcd0052a60 con 0x7efcd815d8e0 2023-09-28T00:15:50.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.512+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7efcd8064050 con 0x7efcc4067330 2023-09-28T00:15:50.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.512+0000 7efcbeffd700 1 -- 172.21.15.26:0/3430794663 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efcd8064050 con 0x7efcc4067330 2023-09-28T00:15:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.514+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efcc4067330 msgr2=0x7efcc40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.514+0000 7efcdd7e4700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efcc4067330 0x7efcc40697e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009f40 tx=0x7efcc80091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.514+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcd815d8e0 msgr2=0x7efcd816ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.514+0000 7efcdd7e4700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcd815d8e0 0x7efcd816ab10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7efcd0001460 tx=0x7efcd0001a40 comp rx=0 tx=0).stop 2023-09-28T00:15:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.515+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 shutdown_connections 2023-09-28T00:15:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.515+0000 7efcdd7e4700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7efcc4067330 0x7efcc40697e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.515+0000 7efcdd7e4700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcd80b3fd0 0x7efcd815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.515+0000 7efcdd7e4700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcd815d8e0 0x7efcd816ab10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.515+0000 7efcdd7e4700 1 --2- 172.21.15.26:0/3430794663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcd8159500 0x7efcd8169a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.515+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 >> 172.21.15.26:0/3430794663 conn(0x7efcd8067630 msgr2=0x7efcd80cf8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.515+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 shutdown_connections 2023-09-28T00:15:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.515+0000 7efcdd7e4700 1 -- 172.21.15.26:0/3430794663 wait complete. 2023-09-28T00:15:50.517 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 5 to deep-scrub 2023-09-28T00:15:50.527 INFO:tasks.ceph:Scrubbing osd.6 2023-09-28T00:15:50.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:15:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.649+0000 7f74d7979700 1 Processor -- start 2023-09-28T00:15:50.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.649+0000 7f74d7979700 1 -- start start 2023-09-28T00:15:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d7979700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74d00b55b0 0x7f74d00ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d7979700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d00cbed0 con 0x7f74d00d0f00 2023-09-28T00:15:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d7979700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d00cc750 con 0x7f74d00cf800 2023-09-28T00:15:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d7979700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d0159d40 con 0x7f74d00b55b0 2023-09-28T00:15:50.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d5715700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74d00b55b0 0x7f74d00ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d5f16700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f74d00d0f00 0x7f74d00ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49320/0 (socket says 172.21.15.26:49320) 2023-09-28T00:15:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d5f16700 1 -- 172.21.15.26:0/2937838391 learned_addr learned my addr 172.21.15.26:0/2937838391 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d5715700 1 -- 172.21.15.26:0/2937838391 >> v1:172.21.15.190:6789/0 conn(0x7f74d00cf800 legacy=0x7f74d00b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d5715700 1 -- 172.21.15.26:0/2937838391 >> v1:172.21.15.26:6789/0 conn(0x7f74d00d0f00 legacy=0x7f74d00ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74cffff700 1 -- 172.21.15.26:0/2937838391 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1803959643 0 0) 0x7f74d00cbed0 con 0x7f74d00d0f00 2023-09-28T00:15:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d5715700 1 -- 172.21.15.26:0/2937838391 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d00cffe0 con 0x7f74d00b55b0 2023-09-28T00:15:50.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74d5715700 1 --2- 172.21.15.26:0/2937838391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00b55b0 0x7f74d00ccbe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009eb0 tx=0x7f74c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23184f3f1594cc82 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74cffff700 1 -- 172.21.15.26:0/2937838391 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c000e070 con 0x7f74d00b55b0 2023-09-28T00:15:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74cffff700 1 -- 172.21.15.26:0/2937838391 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c000bc30 con 0x7f74d00b55b0 2023-09-28T00:15:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.650+0000 7f74cffff700 1 -- 172.21.15.26:0/2937838391 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0012430 con 0x7f74d00b55b0 2023-09-28T00:15:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.651+0000 7f74d7979700 1 -- 172.21.15.26:0/2937838391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00b55b0 msgr2=0x7f74d00ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.651+0000 7f74d7979700 1 --2- 172.21.15.26:0/2937838391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00b55b0 0x7f74d00ccbe0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f74c0009eb0 tx=0x7f74c0009780 comp rx=0 tx=0).stop 2023-09-28T00:15:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.651+0000 7f74d7979700 1 -- 172.21.15.26:0/2937838391 shutdown_connections 2023-09-28T00:15:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.651+0000 7f74d7979700 1 --2- 172.21.15.26:0/2937838391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00b55b0 0x7f74d00ccbe0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.651+0000 7f74d7979700 1 -- 172.21.15.26:0/2937838391 >> 172.21.15.26:0/2937838391 conn(0x7f74d008a050 msgr2=0x7f74d0099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:50.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.651+0000 7f74d7979700 1 -- 172.21.15.26:0/2937838391 shutdown_connections 2023-09-28T00:15:50.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.651+0000 7f74d7979700 1 -- 172.21.15.26:0/2937838391 wait complete. 2023-09-28T00:15:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.652+0000 7f74d7979700 1 Processor -- start 2023-09-28T00:15:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.652+0000 7f74d7979700 1 -- start start 2023-09-28T00:15:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d7979700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74d00b55b0 0x7f74d0158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d7979700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00cf800 0x7f74d0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d7979700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74d00d0f00 0x7f74d0069000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d7979700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d0068b70 con 0x7f74d00cf800 2023-09-28T00:15:50.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d7979700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d0067f60 con 0x7f74d00d0f00 2023-09-28T00:15:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d7979700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d0068240 con 0x7f74d00b55b0 2023-09-28T00:15:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d4f14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00cf800 0x7f74d0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d4f14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00cf800 0x7f74d0067630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40306/0 (socket says 172.21.15.26:40306) 2023-09-28T00:15:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d4f14700 1 -- 172.21.15.26:0/976806721 learned_addr learned my addr 172.21.15.26:0/976806721 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d5f16700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74d00d0f00 0x7f74d0069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d5715700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74d00b55b0 0x7f74d0158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d4f14700 1 -- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74d00b55b0 msgr2=0x7f74d0158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d4f14700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74d00b55b0 0x7f74d0158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d4f14700 1 -- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74d00d0f00 msgr2=0x7f74d0069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d4f14700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74d00d0f00 0x7f74d0069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d4f14700 1 -- 172.21.15.26:0/976806721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c0009a20 con 0x7f74d00cf800 2023-09-28T00:15:50.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.653+0000 7f74d5f16700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74d00d0f00 0x7f74d0069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:15:50.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.654+0000 7f74d4f14700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00cf800 0x7f74d0067630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c590 tx=0x7f74c400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.654+0000 7f74cd7fa700 1 -- 172.21.15.26:0/976806721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4011590 con 0x7f74d00cf800 2023-09-28T00:15:50.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.654+0000 7f74cd7fa700 1 -- 172.21.15.26:0/976806721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c40116f0 con 0x7f74d00cf800 2023-09-28T00:15:50.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.654+0000 7f74cd7fa700 1 -- 172.21.15.26:0/976806721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4011ab0 con 0x7f74d00cf800 2023-09-28T00:15:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.654+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d0068520 con 0x7f74d00cf800 2023-09-28T00:15:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.654+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d0158c60 con 0x7f74d00cf800 2023-09-28T00:15:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.655+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74d00717c0 con 0x7f74d00cf800 2023-09-28T00:15:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.655+0000 7f74cd7fa700 1 -- 172.21.15.26:0/976806721 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f74c401b3b0 con 0x7f74d00cf800 2023-09-28T00:15:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.655+0000 7f74cd7fa700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f74bc067330 0x7f74bc0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.656+0000 7f74cd7fa700 1 -- 172.21.15.26:0/976806721 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74c4084120 con 0x7f74d00cf800 2023-09-28T00:15:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.656+0000 7f74cd7fa700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f74bc06fbe0 0x7f74bc071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.656+0000 7f74cd7fa700 1 -- 172.21.15.26:0/976806721 --> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74bc0726a0 con 0x7f74bc06fbe0 2023-09-28T00:15:50.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.656+0000 7f74cd7fa700 1 -- 172.21.15.26:0/976806721 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74c4086700 con 0x7f74d00cf800 2023-09-28T00:15:50.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.656+0000 7f74d5715700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f74bc067330 0x7f74bc0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.656+0000 7f74d5f16700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f74bc06fbe0 0x7f74bc071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.656+0000 7f74d5715700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f74bc067330 0x7f74bc0697e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f74c00099f0 tx=0x7f74c0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.656+0000 7f74d5f16700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f74bc06fbe0 0x7f74bc071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.657+0000 7f74cd7fa700 1 -- 172.21.15.26:0/976806721 <== osd.6 v2:172.21.15.190:6823/90456 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f74bc0726a0 con 0x7f74bc06fbe0 2023-09-28T00:15:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.671+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 --> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f74d006b030 con 0x7f74bc06fbe0 2023-09-28T00:15:50.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74cd7fa700 1 -- 172.21.15.26:0/976806721 <== osd.6 v2:172.21.15.190:6823/90456 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f74d006b030 con 0x7f74bc06fbe0 2023-09-28T00:15:50.673 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-09-28T00:15:50.673 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:15:50.673 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-09-28T00:15:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f74bc06fbe0 msgr2=0x7f74bc071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6823/90456,v1:172.21.15.190:6825/90456] conn(0x7f74bc06fbe0 0x7f74bc071ff0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.674 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f74bc067330 msgr2=0x7f74bc0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f74bc067330 0x7f74bc0697e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f74c00099f0 tx=0x7f74c0017000 comp rx=0 tx=0).stop 2023-09-28T00:15:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00cf800 msgr2=0x7f74d0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 --2- 172.21.15.26:0/976806721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74d00cf800 0x7f74d0067630 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c590 tx=0x7f74c400c950 comp rx=0 tx=0).stop 2023-09-28T00:15:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d5f16700 1 -- 172.21.15.26:0/976806721 reap_dead start 2023-09-28T00:15:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 shutdown_connections 2023-09-28T00:15:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 >> 172.21.15.26:0/976806721 conn(0x7f74d008a050 msgr2=0x7f74d0158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 shutdown_connections 2023-09-28T00:15:50.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.672+0000 7f74d7979700 1 -- 172.21.15.26:0/976806721 wait complete. 2023-09-28T00:15:50.684 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-09-28T00:15:50.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.803+0000 7f5deba76700 1 Processor -- start 2023-09-28T00:15:50.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.804+0000 7f5deba76700 1 -- start start 2023-09-28T00:15:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.804+0000 7f5deba76700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5de4159500 0x7f5de41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.804+0000 7f5deba76700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de415dab0 0x7f5de40cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.804+0000 7f5deba76700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de40b1110 con 0x7f5de40b3fd0 2023-09-28T00:15:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.804+0000 7f5deba76700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de40b13b0 con 0x7f5de4159500 2023-09-28T00:15:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.804+0000 7f5deba76700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40b1690 con 0x7f5de415dab0 2023-09-28T00:15:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5de9011700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5de40b3fd0 0x7f5de415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49326/0 (socket says 172.21.15.26:49326) 2023-09-28T00:15:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5de9011700 1 -- 172.21.15.26:0/3502158538 learned_addr learned my addr 172.21.15.26:0/3502158538 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5dea013700 1 --2- 172.21.15.26:0/3502158538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de415dab0 0x7f5de40cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5de9812700 1 --2- 172.21.15.26:0/3502158538 >> v2:172.21.15.190:3300/0 conn(0x7f5de4159500 0x7f5de41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5de8810700 1 -- 172.21.15.26:0/3502158538 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605918038 0 0) 0x7f5de40b1110 con 0x7f5de40b3fd0 2023-09-28T00:15:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5de8810700 1 -- 172.21.15.26:0/3502158538 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dcc003570 con 0x7f5de40b3fd0 2023-09-28T00:15:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5de8810700 1 -- 172.21.15.26:0/3502158538 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3017643084 0 0) 0x7f5dcc003570 con 0x7f5de40b3fd0 2023-09-28T00:15:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5dea013700 1 -- 172.21.15.26:0/3502158538 >> v2:172.21.15.190:3300/0 conn(0x7f5de4159500 msgr2=0x7f5de41598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5dea013700 1 --2- 172.21.15.26:0/3502158538 >> v2:172.21.15.190:3300/0 conn(0x7f5de4159500 0x7f5de41598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5dea013700 1 -- 172.21.15.26:0/3502158538 >> v1:172.21.15.26:6789/0 conn(0x7f5de40b3fd0 legacy=0x7f5de415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5dea013700 1 -- 172.21.15.26:0/3502158538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40b1970 con 0x7f5de415dab0 2023-09-28T00:15:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5de9812700 1 --2- 172.21.15.26:0/3502158538 >> v2:172.21.15.190:3300/0 conn(0x7f5de4159500 0x7f5de41598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-28T00:15:50.809 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.805+0000 7f5dea013700 1 --2- 172.21.15.26:0/3502158538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de415dab0 0x7f5de40cf6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009e60 tx=0x7f5dd4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6aff66539f3204a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5de8810700 1 -- 172.21.15.26:0/3502158538 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd400e070 con 0x7f5de415dab0 2023-09-28T00:15:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5de8810700 1 -- 172.21.15.26:0/3502158538 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd400b7a0 con 0x7f5de415dab0 2023-09-28T00:15:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5de8810700 1 -- 172.21.15.26:0/3502158538 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8001470 con 0x7f5de415dab0 2023-09-28T00:15:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5deba76700 1 -- 172.21.15.26:0/3502158538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de415dab0 msgr2=0x7f5de40cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5deba76700 1 --2- 172.21.15.26:0/3502158538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de415dab0 0x7f5de40cf6c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009e60 tx=0x7f5dd4009780 comp rx=0 tx=0).stop 2023-09-28T00:15:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5deba76700 1 -- 172.21.15.26:0/3502158538 shutdown_connections 2023-09-28T00:15:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5deba76700 1 --2- 172.21.15.26:0/3502158538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de415dab0 0x7f5de40cf6c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.810 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5deba76700 1 --2- 172.21.15.26:0/3502158538 >> v2:172.21.15.190:3300/0 conn(0x7f5de4159500 0x7f5de41598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5deba76700 1 -- 172.21.15.26:0/3502158538 >> 172.21.15.26:0/3502158538 conn(0x7f5de4067630 msgr2=0x7f5de4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5deba76700 1 -- 172.21.15.26:0/3502158538 shutdown_connections 2023-09-28T00:15:50.811 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.806+0000 7f5deba76700 1 -- 172.21.15.26:0/3502158538 wait complete. 2023-09-28T00:15:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.807+0000 7f5deba76700 1 Processor -- start 2023-09-28T00:15:50.813 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.807+0000 7f5deba76700 1 -- start start 2023-09-28T00:15:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5deba76700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de40b3fd0 0x7f5de4143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5deba76700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5de4159500 0x7f5de40cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5deba76700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5de415dab0 0x7f5de40cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5deba76700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4149630 con 0x7f5de415dab0 2023-09-28T00:15:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5deba76700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4149910 con 0x7f5de4159500 2023-09-28T00:15:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5deba76700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4149bf0 con 0x7f5de40b3fd0 2023-09-28T00:15:50.814 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5dea013700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5de415dab0 0x7f5de40cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5dea013700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5de415dab0 0x7f5de40cfbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40316/0 (socket says 172.21.15.26:40316) 2023-09-28T00:15:50.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5dea013700 1 -- 172.21.15.26:0/845875266 learned_addr learned my addr 172.21.15.26:0/845875266 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:50.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5de9812700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de40b3fd0 0x7f5de4143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5de9011700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5de4159500 0x7f5de40cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5dea013700 1 -- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de40b3fd0 msgr2=0x7f5de4143db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5dea013700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de40b3fd0 0x7f5de4143db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5dea013700 1 -- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5de4159500 msgr2=0x7f5de40cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:50.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5dea013700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5de4159500 0x7f5de40cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.808+0000 7f5dea013700 1 -- 172.21.15.26:0/845875266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc009420 con 0x7f5de415dab0 2023-09-28T00:15:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.809+0000 7f5dea013700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5de415dab0 0x7f5de40cfbe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4003000 tx=0x7f5dd4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.809+0000 7f5de1ffb700 1 -- 172.21.15.26:0/845875266 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4012bc0 con 0x7f5de415dab0 2023-09-28T00:15:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.809+0000 7f5de1ffb700 1 -- 172.21.15.26:0/845875266 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd4012d60 con 0x7f5de415dab0 2023-09-28T00:15:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.809+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd4009a20 con 0x7f5de415dab0 2023-09-28T00:15:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.809+0000 7f5de1ffb700 1 -- 172.21.15.26:0/845875266 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd401d680 con 0x7f5de415dab0 2023-09-28T00:15:50.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.809+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de4144ae0 con 0x7f5de415dab0 2023-09-28T00:15:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.810+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de4149a50 con 0x7f5de415dab0 2023-09-28T00:15:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.810+0000 7f5de1ffb700 1 -- 172.21.15.26:0/845875266 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f5dd4024070 con 0x7f5de415dab0 2023-09-28T00:15:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.811+0000 7f5de1ffb700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5dd0067330 0x7f5dd00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.811+0000 7f5de1ffb700 1 -- 172.21.15.26:0/845875266 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5dd4086c20 con 0x7f5de415dab0 2023-09-28T00:15:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.811+0000 7f5de9812700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5dd0067330 0x7f5dd00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:50.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.811+0000 7f5de9812700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5dd0067330 0x7f5dd00697e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5de4155a20 tx=0x7f5ddc0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:50.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:50.815+0000 7f5de1ffb700 1 -- 172.21.15.26:0/845875266 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5de4149a50 con 0x7f5de415dab0 2023-09-28T00:15:51.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.007+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5de4149a50 con 0x7f5dd0067330 2023-09-28T00:15:51.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.008+0000 7f5de1ffb700 1 -- 172.21.15.26:0/845875266 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5de4149a50 con 0x7f5dd0067330 2023-09-28T00:15:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5dd0067330 msgr2=0x7f5dd00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5dd0067330 0x7f5dd00697e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5de4155a20 tx=0x7f5ddc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5de415dab0 msgr2=0x7f5de40cfbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5de415dab0 0x7f5de40cfbe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4003000 tx=0x7f5dd4018000 comp rx=0 tx=0).stop 2023-09-28T00:15:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 shutdown_connections 2023-09-28T00:15:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f5dd0067330 0x7f5dd00697e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5de40b3fd0 0x7f5de4143db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5de415dab0 0x7f5de40cfbe0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 --2- 172.21.15.26:0/845875266 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5de4159500 0x7f5de40cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 >> 172.21.15.26:0/845875266 conn(0x7f5de4067630 msgr2=0x7f5de414a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 shutdown_connections 2023-09-28T00:15:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.010+0000 7f5deba76700 1 -- 172.21.15.26:0/845875266 wait complete. 2023-09-28T00:15:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 6 to deep-scrub 2023-09-28T00:15:51.023 INFO:tasks.ceph:Scrubbing osd.7 2023-09-28T00:15:51.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-09-28T00:15:51.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.145+0000 7f6ef2171700 1 Processor -- start 2023-09-28T00:15:51.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.145+0000 7f6ef2171700 1 -- start start 2023-09-28T00:15:51.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6ef2171700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6eec0b55b0 0x7f6eec0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6ef2171700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec0cbed0 con 0x7f6eec0d0f00 2023-09-28T00:15:51.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6ef2171700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec0cc750 con 0x7f6eec0cf800 2023-09-28T00:15:51.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6ef2171700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eec159d40 con 0x7f6eec0b55b0 2023-09-28T00:15:51.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6eeb7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6eec0b55b0 0x7f6eec0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6eeb7fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6eec0b55b0 0x7f6eec0ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40320/0 (socket says 172.21.15.26:40320) 2023-09-28T00:15:51.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6eebfff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6eec0d0f00 0x7f6eec0ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49332/0 (socket says 172.21.15.26:49332) 2023-09-28T00:15:51.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6eebfff700 1 -- 172.21.15.26:0/1804645478 learned_addr learned my addr 172.21.15.26:0/1804645478 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:51.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6eeb7fe700 1 -- 172.21.15.26:0/1804645478 >> v1:172.21.15.190:6789/0 conn(0x7f6eec0cf800 legacy=0x7f6eec0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:51.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.146+0000 7f6eeb7fe700 1 -- 172.21.15.26:0/1804645478 >> v1:172.21.15.26:6789/0 conn(0x7f6eec0d0f00 legacy=0x7f6eec0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6eeb7fe700 1 -- 172.21.15.26:0/1804645478 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0cffe0 con 0x7f6eec0b55b0 2023-09-28T00:15:51.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6eea7fc700 1 -- 172.21.15.26:0/1804645478 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686373575 0 0) 0x7f6eec0cbed0 con 0x7f6eec0d0f00 2023-09-28T00:15:51.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6eeb7fe700 1 --2- 172.21.15.26:0/1804645478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 0x7f6eec0ccbe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0098d0 tx=0x7f6edc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed2c25a02630cf1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6eea7fc700 1 -- 172.21.15.26:0/1804645478 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc009e70 con 0x7f6eec0b55b0 2023-09-28T00:15:51.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6eea7fc700 1 -- 172.21.15.26:0/1804645478 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc005c10 con 0x7f6eec0b55b0 2023-09-28T00:15:51.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6eea7fc700 1 -- 172.21.15.26:0/1804645478 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc00b610 con 0x7f6eec0b55b0 2023-09-28T00:15:51.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6ef2171700 1 -- 172.21.15.26:0/1804645478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 msgr2=0x7f6eec0ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6ef2171700 1 --2- 172.21.15.26:0/1804645478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 0x7f6eec0ccbe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6edc0098d0 tx=0x7f6edc009120 comp rx=0 tx=0).stop 2023-09-28T00:15:51.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6ef2171700 1 -- 172.21.15.26:0/1804645478 shutdown_connections 2023-09-28T00:15:51.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6ef2171700 1 --2- 172.21.15.26:0/1804645478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 0x7f6eec0ccbe0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6ef2171700 1 -- 172.21.15.26:0/1804645478 >> 172.21.15.26:0/1804645478 conn(0x7f6eec08a050 msgr2=0x7f6eec099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:51.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6ef2171700 1 -- 172.21.15.26:0/1804645478 shutdown_connections 2023-09-28T00:15:51.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.147+0000 7f6ef2171700 1 -- 172.21.15.26:0/1804645478 wait complete. 2023-09-28T00:15:51.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.149+0000 7f6ef2171700 1 Processor -- start 2023-09-28T00:15:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.149+0000 7f6ef2171700 1 -- start start 2023-09-28T00:15:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.149+0000 7f6ef2171700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 0x7f6eec15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.149+0000 7f6ef2171700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6eec0cf800 0x7f6eec0b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.149+0000 7f6ef2171700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eec0d0f00 0x7f6eec0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.149+0000 7f6ef2171700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec15c260 con 0x7f6eec0b55b0 2023-09-28T00:15:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.149+0000 7f6ef2171700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec0afe50 con 0x7f6eec0d0f00 2023-09-28T00:15:51.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.149+0000 7f6ef2171700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec0b0130 con 0x7f6eec0cf800 2023-09-28T00:15:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 0x7f6eec15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 0x7f6eec15ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40322/0 (socket says 172.21.15.26:40322) 2023-09-28T00:15:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeb7fe700 1 -- 172.21.15.26:0/2347313329 learned_addr learned my addr 172.21.15.26:0/2347313329 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeaffd700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6eec0cf800 0x7f6eec0b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eebfff700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eec0d0f00 0x7f6eec0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeb7fe700 1 -- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6eec0cf800 msgr2=0x7f6eec0b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeb7fe700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6eec0cf800 0x7f6eec0b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeb7fe700 1 -- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eec0d0f00 msgr2=0x7f6eec0c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeb7fe700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6eec0d0f00 0x7f6eec0c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeb7fe700 1 -- 172.21.15.26:0/2347313329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc0093c0 con 0x7f6eec0b55b0 2023-09-28T00:15:51.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6eeb7fe700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 0x7f6eec15ca00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6eec071220 tx=0x7f6edc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6ed37fe700 1 -- 172.21.15.26:0/2347313329 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc006a90 con 0x7f6eec0b55b0 2023-09-28T00:15:51.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6ed37fe700 1 -- 172.21.15.26:0/2347313329 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6edc011c80 con 0x7f6eec0b55b0 2023-09-28T00:15:51.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec0b0410 con 0x7f6eec0b55b0 2023-09-28T00:15:51.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6ed37fe700 1 -- 172.21.15.26:0/2347313329 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6edc01c430 con 0x7f6eec0b55b0 2023-09-28T00:15:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.150+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec15d100 con 0x7f6eec0b55b0 2023-09-28T00:15:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.151+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6eec0717c0 con 0x7f6eec0b55b0 2023-09-28T00:15:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.152+0000 7f6ed37fe700 1 -- 172.21.15.26:0/2347313329 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f6edc023070 con 0x7f6eec0b55b0 2023-09-28T00:15:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.152+0000 7f6ed37fe700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ed8067330 0x7f6ed80697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.152+0000 7f6ed37fe700 1 -- 172.21.15.26:0/2347313329 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6edc086aa0 con 0x7f6eec0b55b0 2023-09-28T00:15:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.152+0000 7f6ed37fe700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7f6ed806fbe0 0x7f6ed8071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.152+0000 7f6ed37fe700 1 -- 172.21.15.26:0/2347313329 --> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ed80726a0 con 0x7f6ed806fbe0 2023-09-28T00:15:51.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.152+0000 7f6ed37fe700 1 -- 172.21.15.26:0/2347313329 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6edc08b240 con 0x7f6eec0b55b0 2023-09-28T00:15:51.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.152+0000 7f6eeaffd700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ed8067330 0x7f6ed80697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.152+0000 7f6eebfff700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7f6ed806fbe0 0x7f6ed8071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.153+0000 7f6eeaffd700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ed8067330 0x7f6ed80697e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ce150 tx=0x7f6ee0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.153+0000 7f6eebfff700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7f6ed806fbe0 0x7f6ed8071ff0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.153+0000 7f6ed37fe700 1 -- 172.21.15.26:0/2347313329 <== osd.7 v2:172.21.15.190:6808/90455 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6ed80726a0 con 0x7f6ed806fbe0 2023-09-28T00:15:51.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.167+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 --> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6eec0cc100 con 0x7f6ed806fbe0 2023-09-28T00:15:51.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ed37fe700 1 -- 172.21.15.26:0/2347313329 <== osd.7 v2:172.21.15.190:6808/90455 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6eec0cc100 con 0x7f6ed806fbe0 2023-09-28T00:15:51.169 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-09-28T00:15:51.169 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-28T00:15:51.169 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-09-28T00:15:51.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7f6ed806fbe0 msgr2=0x7f6ed8071ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6808/90455,v1:172.21.15.190:6809/90455] conn(0x7f6ed806fbe0 0x7f6ed8071ff0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ed8067330 msgr2=0x7f6ed80697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f6ed8067330 0x7f6ed80697e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0ce150 tx=0x7f6ee0009040 comp rx=0 tx=0).stop 2023-09-28T00:15:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 msgr2=0x7f6eec15ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 --2- 172.21.15.26:0/2347313329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6eec0b55b0 0x7f6eec15ca00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6eec071220 tx=0x7f6edc015000 comp rx=0 tx=0).stop 2023-09-28T00:15:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6eebfff700 1 -- 172.21.15.26:0/2347313329 reap_dead start 2023-09-28T00:15:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 shutdown_connections 2023-09-28T00:15:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 >> 172.21.15.26:0/2347313329 conn(0x7f6eec08a050 msgr2=0x7f6eec0ad170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:51.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 shutdown_connections 2023-09-28T00:15:51.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.168+0000 7f6ef2171700 1 -- 172.21.15.26:0/2347313329 wait complete. 2023-09-28T00:15:51.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-09-28T00:15:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.299+0000 7fbcac517700 1 Processor -- start 2023-09-28T00:15:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.299+0000 7fbcac517700 1 -- start start 2023-09-28T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcac517700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbca4159500 0x7fbca41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcac517700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 0x7fbca415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcac517700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca415dd20 con 0x7fbca415d8e0 2023-09-28T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcac517700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca40b1110 con 0x7fbca4159500 2023-09-28T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcac517700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40b13b0 con 0x7fbca40b3fd0 2023-09-28T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcaa2b3700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbca4159500 0x7fbca41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcaaab4700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbca415d8e0 0x7fbca40cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49338/0 (socket says 172.21.15.26:49338) 2023-09-28T00:15:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcaaab4700 1 -- 172.21.15.26:0/1262770080 learned_addr learned my addr 172.21.15.26:0/1262770080 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbca9ab2700 1 --2- 172.21.15.26:0/1262770080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 0x7fbca415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcaa2b3700 1 -- 172.21.15.26:0/1262770080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 msgr2=0x7fbca415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.300+0000 7fbcaa2b3700 1 --2- 172.21.15.26:0/1262770080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 0x7fbca415d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcaa2b3700 1 -- 172.21.15.26:0/1262770080 >> v1:172.21.15.26:6789/0 conn(0x7fbca415d8e0 legacy=0x7fbca40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcaa2b3700 1 -- 172.21.15.26:0/1262770080 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40b1690 con 0x7fbca4159500 2023-09-28T00:15:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbca92b1700 1 -- 172.21.15.26:0/1262770080 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065730951 0 0) 0x7fbca415dd20 con 0x7fbca415d8e0 2023-09-28T00:15:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcaa2b3700 1 --2- 172.21.15.26:0/1262770080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4159500 0x7fbca41598d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0098e0 tx=0x7fbc9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129be110a53ad502 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbca92b1700 1 -- 172.21.15.26:0/1262770080 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00b640 con 0x7fbca4159500 2023-09-28T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbca92b1700 1 -- 172.21.15.26:0/1262770080 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c00b7a0 con 0x7fbca4159500 2023-09-28T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbca92b1700 1 -- 172.21.15.26:0/1262770080 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00bb40 con 0x7fbca4159500 2023-09-28T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcac517700 1 -- 172.21.15.26:0/1262770080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4159500 msgr2=0x7fbca41598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcac517700 1 --2- 172.21.15.26:0/1262770080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4159500 0x7fbca41598d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0098e0 tx=0x7fbc9c0091a0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcac517700 1 -- 172.21.15.26:0/1262770080 shutdown_connections 2023-09-28T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcac517700 1 --2- 172.21.15.26:0/1262770080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca4159500 0x7fbca41598d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcac517700 1 --2- 172.21.15.26:0/1262770080 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 0x7fbca415d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcac517700 1 -- 172.21.15.26:0/1262770080 >> 172.21.15.26:0/1262770080 conn(0x7fbca4067630 msgr2=0x7fbca4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcac517700 1 -- 172.21.15.26:0/1262770080 shutdown_connections 2023-09-28T00:15:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.301+0000 7fbcac517700 1 -- 172.21.15.26:0/1262770080 wait complete. 2023-09-28T00:15:51.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcac517700 1 Processor -- start 2023-09-28T00:15:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcac517700 1 -- start start 2023-09-28T00:15:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcac517700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 0x7fbca414b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcac517700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbca4159500 0x7fbca41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcac517700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca415d8e0 0x7fbca415bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcac517700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca415b380 con 0x7fbca415d8e0 2023-09-28T00:15:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcac517700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca414bdb0 con 0x7fbca4159500 2023-09-28T00:15:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcac517700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4159e10 con 0x7fbca40b3fd0 2023-09-28T00:15:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcaaab4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca415d8e0 0x7fbca415bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcaaab4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca415d8e0 0x7fbca415bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40348/0 (socket says 172.21.15.26:40348) 2023-09-28T00:15:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.303+0000 7fbcaaab4700 1 -- 172.21.15.26:0/3533549571 learned_addr learned my addr 172.21.15.26:0/3533549571 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbca9ab2700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbca4159500 0x7fbca41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbcaa2b3700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 0x7fbca414b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbcaaab4700 1 -- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 msgr2=0x7fbca414b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbcaaab4700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 0x7fbca414b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbcaaab4700 1 -- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbca4159500 msgr2=0x7fbca41598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbcaaab4700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbca4159500 0x7fbca41598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbcaaab4700 1 -- 172.21.15.26:0/3533549571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c009420 con 0x7fbca415d8e0 2023-09-28T00:15:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbcaaab4700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca415d8e0 0x7fbca415bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400cbf0 tx=0x7fbc940019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbca27fc700 1 -- 172.21.15.26:0/3533549571 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400a8b0 con 0x7fbca415d8e0 2023-09-28T00:15:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbca27fc700 1 -- 172.21.15.26:0/3533549571 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9400aa10 con 0x7fbca415d8e0 2023-09-28T00:15:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca41574b0 con 0x7fbca415d8e0 2023-09-28T00:15:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbca27fc700 1 -- 172.21.15.26:0/3533549571 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400add0 con 0x7fbca415d8e0 2023-09-28T00:15:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.304+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca415adc0 con 0x7fbca415d8e0 2023-09-28T00:15:51.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.305+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca4157280 con 0x7fbca415d8e0 2023-09-28T00:15:51.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.306+0000 7fbca27fc700 1 -- 172.21.15.26:0/3533549571 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fbc94007300 con 0x7fbca415d8e0 2023-09-28T00:15:51.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.306+0000 7fbca27fc700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbc90067330 0x7fbc900697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.306+0000 7fbca27fc700 1 -- 172.21.15.26:0/3533549571 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbc94084e30 con 0x7fbca415d8e0 2023-09-28T00:15:51.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.306+0000 7fbcaa2b3700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbc90067330 0x7fbc900697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.307+0000 7fbcaa2b3700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbc90067330 0x7fbc900697e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0093f0 tx=0x7fbc9c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.310+0000 7fbca27fc700 1 -- 172.21.15.26:0/3533549571 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fbca4157280 con 0x7fbca415d8e0 2023-09-28T00:15:51.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.503+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fbca4157280 con 0x7fbc90067330 2023-09-28T00:15:51.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.505+0000 7fbca27fc700 1 -- 172.21.15.26:0/3533549571 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbca4157280 con 0x7fbc90067330 2023-09-28T00:15:51.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbc90067330 msgr2=0x7fbc900697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbc90067330 0x7fbc900697e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c0093f0 tx=0x7fbc9c017000 comp rx=0 tx=0).stop 2023-09-28T00:15:51.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca415d8e0 msgr2=0x7fbca415bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca415d8e0 0x7fbca415bf30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400cbf0 tx=0x7fbc940019b0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 shutdown_connections 2023-09-28T00:15:51.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fbc90067330 0x7fbc900697e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbca40b3fd0 0x7fbca414b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbca415d8e0 0x7fbca415bf30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 --2- 172.21.15.26:0/3533549571 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbca4159500 0x7fbca41598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 >> 172.21.15.26:0/3533549571 conn(0x7fbca4067630 msgr2=0x7fbca4069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:51.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 shutdown_connections 2023-09-28T00:15:51.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.506+0000 7fbcac517700 1 -- 172.21.15.26:0/3533549571 wait complete. 2023-09-28T00:15:51.509 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 7 to deep-scrub 2023-09-28T00:15:51.519 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:15:51.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.637+0000 7f34e8ea4700 1 Processor -- start 2023-09-28T00:15:51.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.637+0000 7f34e8ea4700 1 -- start start 2023-09-28T00:15:51.640 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e8ea4700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34e40cdc00 0x7f34e40cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e8ea4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40c6dc0 0x7f34e40ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e8ea4700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e40ae140 con 0x7f34e40d1030 2023-09-28T00:15:51.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e8ea4700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e40cc390 con 0x7f34e40cdc00 2023-09-28T00:15:51.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e8ea4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40ad530 con 0x7f34e40c6dc0 2023-09-28T00:15:51.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e259c700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34e40cdc00 0x7f34e40cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e1d9b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f34e40d1030 0x7f34e40c66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:56990/0 (socket says 172.21.15.26:56990) 2023-09-28T00:15:51.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e1d9b700 1 -- 172.21.15.26:0/3546450974 learned_addr learned my addr 172.21.15.26:0/3546450974 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:15:51.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e2d9d700 1 --2- 172.21.15.26:0/3546450974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40c6dc0 0x7f34e40ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e259c700 1 -- 172.21.15.26:0/3546450974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40c6dc0 msgr2=0x7f34e40ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:15:51.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e259c700 1 --2- 172.21.15.26:0/3546450974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40c6dc0 0x7f34e40ae5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e259c700 1 -- 172.21.15.26:0/3546450974 >> v1:172.21.15.26:6789/0 conn(0x7f34e40d1030 legacy=0x7f34e40c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.638+0000 7f34e159a700 1 -- 172.21.15.26:0/3546450974 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868617484 0 0) 0x7f34e40ae140 con 0x7f34e40d1030 2023-09-28T00:15:51.642 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e259c700 1 -- 172.21.15.26:0/3546450974 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e40ad810 con 0x7f34e40cdc00 2023-09-28T00:15:51.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e259c700 1 --2- 172.21.15.26:0/3546450974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40cdc00 0x7f34e40cbe50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f34d40098d0 tx=0x7f34d4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a991b7be952853b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e159a700 1 -- 172.21.15.26:0/3546450974 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d4009e70 con 0x7f34e40cdc00 2023-09-28T00:15:51.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e159a700 1 -- 172.21.15.26:0/3546450974 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d4005c10 con 0x7f34e40cdc00 2023-09-28T00:15:51.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e159a700 1 -- 172.21.15.26:0/3546450974 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d400b650 con 0x7f34e40cdc00 2023-09-28T00:15:51.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e8ea4700 1 -- 172.21.15.26:0/3546450974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40cdc00 msgr2=0x7f34e40cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e8ea4700 1 --2- 172.21.15.26:0/3546450974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40cdc00 0x7f34e40cbe50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f34d40098d0 tx=0x7f34d4009120 comp rx=0 tx=0).stop 2023-09-28T00:15:51.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e8ea4700 1 -- 172.21.15.26:0/3546450974 shutdown_connections 2023-09-28T00:15:51.643 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e8ea4700 1 --2- 172.21.15.26:0/3546450974 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40c6dc0 0x7f34e40ae5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e8ea4700 1 --2- 172.21.15.26:0/3546450974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40cdc00 0x7f34e40cbe50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e8ea4700 1 -- 172.21.15.26:0/3546450974 >> 172.21.15.26:0/3546450974 conn(0x7f34e4099990 msgr2=0x7f34e40b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:51.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.639+0000 7f34e8ea4700 1 -- 172.21.15.26:0/3546450974 shutdown_connections 2023-09-28T00:15:51.644 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.640+0000 7f34e8ea4700 1 -- 172.21.15.26:0/3546450974 wait complete. 2023-09-28T00:15:51.646 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e8ea4700 1 Processor -- start 2023-09-28T00:15:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e8ea4700 1 -- start start 2023-09-28T00:15:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e8ea4700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e40c6dc0 0x7f34e4145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e8ea4700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40cdc00 0x7f34e409d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e8ea4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40d1030 0x7f34e409da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e8ea4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40c9920 con 0x7f34e40d1030 2023-09-28T00:15:51.647 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e8ea4700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e41587c0 con 0x7f34e40c6dc0 2023-09-28T00:15:51.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e8ea4700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e40c8d10 con 0x7f34e40cdc00 2023-09-28T00:15:51.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40d1030 0x7f34e409da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40d1030 0x7f34e409da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:43150/0 (socket says 172.21.15.26:43150) 2023-09-28T00:15:51.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e2d9d700 1 -- 172.21.15.26:0/2748102397 learned_addr learned my addr 172.21.15.26:0/2748102397 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:15:51.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e1d9b700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40cdc00 0x7f34e409d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.641+0000 7f34e259c700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e40c6dc0 0x7f34e4145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34e2d9d700 1 -- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40cdc00 msgr2=0x7f34e409d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34e2d9d700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40cdc00 0x7f34e409d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34e2d9d700 1 -- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e40c6dc0 msgr2=0x7f34e4145880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34e2d9d700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e40c6dc0 0x7f34e4145880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34e2d9d700 1 -- 172.21.15.26:0/2748102397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40093c0 con 0x7f34e40d1030 2023-09-28T00:15:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34e2d9d700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40d1030 0x7f34e409da30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34dc007f20 tx=0x7f34dc0098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34da7fc700 1 -- 172.21.15.26:0/2748102397 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc00eb90 con 0x7f34e40d1030 2023-09-28T00:15:51.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34da7fc700 1 -- 172.21.15.26:0/2748102397 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc00ed10 con 0x7f34e40d1030 2023-09-28T00:15:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e40c8ff0 con 0x7f34e40d1030 2023-09-28T00:15:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34da7fc700 1 -- 172.21.15.26:0/2748102397 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc014670 con 0x7f34e40d1030 2023-09-28T00:15:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.642+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e40c95b0 con 0x7f34e40d1030 2023-09-28T00:15:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.643+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e4064050 con 0x7f34e40d1030 2023-09-28T00:15:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.643+0000 7f34da7fc700 1 -- 172.21.15.26:0/2748102397 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f34dc014a60 con 0x7f34e40d1030 2023-09-28T00:15:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.644+0000 7f34da7fc700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f34c4067330 0x7f34c40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:15:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.644+0000 7f34da7fc700 1 -- 172.21.15.26:0/2748102397 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f34dc0851c0 con 0x7f34e40d1030 2023-09-28T00:15:51.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.644+0000 7f34e259c700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f34c4067330 0x7f34c40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:15:51.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.644+0000 7f34e259c700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f34c4067330 0x7f34c40697e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f34e416cbb0 tx=0x7f34d4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:15:51.651 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.648+0000 7f34da7fc700 1 -- 172.21.15.26:0/2748102397 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f34dc0520c0 con 0x7f34e40d1030 2023-09-28T00:15:51.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.836+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34e406a950 con 0x7f34c4067330 2023-09-28T00:15:51.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.845+0000 7f34da7fc700 1 -- 172.21.15.26:0/2748102397 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281717 (secure 0 0 0) 0x7f34e406a950 con 0x7f34c4067330 2023-09-28T00:15:51.848 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:15:51.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f34c4067330 msgr2=0x7f34c40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f34c4067330 0x7f34c40697e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f34e416cbb0 tx=0x7f34d4016000 comp rx=0 tx=0).stop 2023-09-28T00:15:51.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40d1030 msgr2=0x7f34e409da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:15:51.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40d1030 0x7f34e409da30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f34dc007f20 tx=0x7f34dc0098a0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 shutdown_connections 2023-09-28T00:15:51.851 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f34c4067330 0x7f34c40697e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e40d1030 0x7f34e409da30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e40c6dc0 0x7f34e4145880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 --2- 172.21.15.26:0/2748102397 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e40cdc00 0x7f34e409d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:15:51.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 >> 172.21.15.26:0/2748102397 conn(0x7f34e4099990 msgr2=0x7f34e40cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:15:51.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 shutdown_connections 2023-09-28T00:15:51.852 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:15:51.848+0000 7f34e8ea4700 1 -- 172.21.15.26:0/2748102397 wait complete. 2023-09-28T00:15:51.852 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:15:51.861 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-09-28T00:15:51.673255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66344,"kb_used_data":3176,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908376,"statfs":{"total":773094113280,"available":773026177024,"internally_reserved":0,"allocated":3252224,"data_stored":1930452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003112"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.380230+0000","last_change":"2023-09-28T00:15:29.392083+0000","last_active":"2023-09-28T00:15:30.380230+0000","last_peered":"2023-09-28T00:15:30.380230+0000","last_clean":"2023-09-28T00:15:30.380230+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:15:30.380230+0000","last_undegraded":"2023-09-28T00:15:30.380230+0000","last_fullsized":"2023-09-28T00:15:30.380230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593294+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:15:30.593294+0000","last_peered":"2023-09-28T00:15:30.593294+0000","last_clean":"2023-09-28T00:15:30.593294+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:15:30.593294+0000","last_undegraded":"2023-09-28T00:15:30.593294+0000","last_fullsized":"2023-09-28T00:15:30.593294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777850+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:15:30.777850+0000","last_peered":"2023-09-28T00:15:30.777850+0000","last_clean":"2023-09-28T00:15:30.777850+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:15:30.777850+0000","last_undegraded":"2023-09-28T00:15:30.777850+0000","last_fullsized":"2023-09-28T00:15:30.777850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394940+0000","last_change":"2023-09-28T00:15:29.387338+0000","last_active":"2023-09-28T00:15:29.394940+0000","last_peered":"2023-09-28T00:15:29.394940+0000","last_clean":"2023-09-28T00:15:29.394940+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:15:29.394940+0000","last_undegraded":"2023-09-28T00:15:29.394940+0000","last_fullsized":"2023-09-28T00:15:29.394940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:11.621953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778977+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:15:30.778977+0000","last_peered":"2023-09-28T00:15:30.778977+0000","last_clean":"2023-09-28T00:15:30.778977+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:15:30.778977+0000","last_undegraded":"2023-09-28T00:15:30.778977+0000","last_fullsized":"2023-09-28T00:15:30.778977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777490+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:15:30.777490+0000","last_peered":"2023-09-28T00:15:30.777490+0000","last_clean":"2023-09-28T00:15:30.777490+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:15:30.777490+0000","last_undegraded":"2023-09-28T00:15:30.777490+0000","last_fullsized":"2023-09-28T00:15:30.777490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.390765+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:15:29.390765+0000","last_peered":"2023-09-28T00:15:29.390765+0000","last_clean":"2023-09-28T00:15:29.390765+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:15:29.390765+0000","last_undegraded":"2023-09-28T00:15:29.390765+0000","last_fullsized":"2023-09-28T00:15:29.390765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T12:10:55.761771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593084+0000","last_change":"2023-09-28T00:15:29.398742+0000","last_active":"2023-09-28T00:15:30.593084+0000","last_peered":"2023-09-28T00:15:30.593084+0000","last_clean":"2023-09-28T00:15:30.593084+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:15:30.593084+0000","last_undegraded":"2023-09-28T00:15:30.593084+0000","last_fullsized":"2023-09-28T00:15:30.593084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778184+0000","last_change":"2023-09-28T00:15:29.401666+0000","last_active":"2023-09-28T00:15:30.778184+0000","last_peered":"2023-09-28T00:15:30.778184+0000","last_clean":"2023-09-28T00:15:30.778184+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:15:30.778184+0000","last_undegraded":"2023-09-28T00:15:30.778184+0000","last_fullsized":"2023-09-28T00:15:30.778184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593419+0000","last_change":"2023-09-28T00:15:29.388253+0000","last_active":"2023-09-28T00:15:30.593419+0000","last_peered":"2023-09-28T00:15:30.593419+0000","last_clean":"2023-09-28T00:15:30.593419+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:15:30.593419+0000","last_undegraded":"2023-09-28T00:15:30.593419+0000","last_fullsized":"2023-09-28T00:15:30.593419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778029+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:15:30.778029+0000","last_peered":"2023-09-28T00:15:30.778029+0000","last_clean":"2023-09-28T00:15:30.778029+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:15:30.778029+0000","last_undegraded":"2023-09-28T00:15:30.778029+0000","last_fullsized":"2023-09-28T00:15:30.778029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.380114+0000","last_change":"2023-09-28T00:15:29.399521+0000","last_active":"2023-09-28T00:15:30.380114+0000","last_peered":"2023-09-28T00:15:30.380114+0000","last_clean":"2023-09-28T00:15:30.380114+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:15:30.380114+0000","last_undegraded":"2023-09-28T00:15:30.380114+0000","last_fullsized":"2023-09-28T00:15:30.380114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.380070+0000","last_change":"2023-09-28T00:15:29.392028+0000","last_active":"2023-09-28T00:15:30.380070+0000","last_peered":"2023-09-28T00:15:30.380070+0000","last_clean":"2023-09-28T00:15:30.380070+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:15:30.380070+0000","last_undegraded":"2023-09-28T00:15:30.380070+0000","last_fullsized":"2023-09-28T00:15:30.380070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593238+0000","last_change":"2023-09-28T00:15:29.394175+0000","last_active":"2023-09-28T00:15:30.593238+0000","last_peered":"2023-09-28T00:15:30.593238+0000","last_clean":"2023-09-28T00:15:30.593238+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:15:30.593238+0000","last_undegraded":"2023-09-28T00:15:30.593238+0000","last_fullsized":"2023-09-28T00:15:30.593238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394506+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:15:29.394506+0000","last_peered":"2023-09-28T00:15:29.394506+0000","last_clean":"2023-09-28T00:15:29.394506+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:15:29.394506+0000","last_undegraded":"2023-09-28T00:15:29.394506+0000","last_fullsized":"2023-09-28T00:15:29.394506+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:53:44.402693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777473+0000","last_change":"2023-09-28T00:15:29.397273+0000","last_active":"2023-09-28T00:15:30.777473+0000","last_peered":"2023-09-28T00:15:30.777473+0000","last_clean":"2023-09-28T00:15:30.777473+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:15:30.777473+0000","last_undegraded":"2023-09-28T00:15:30.777473+0000","last_fullsized":"2023-09-28T00:15:30.777473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778247+0000","last_change":"2023-09-28T00:15:29.401695+0000","last_active":"2023-09-28T00:15:30.778247+0000","last_peered":"2023-09-28T00:15:30.778247+0000","last_clean":"2023-09-28T00:15:30.778247+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:15:30.778247+0000","last_undegraded":"2023-09-28T00:15:30.778247+0000","last_fullsized":"2023-09-28T00:15:30.778247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777948+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:15:30.777948+0000","last_peered":"2023-09-28T00:15:30.777948+0000","last_clean":"2023-09-28T00:15:30.777948+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:15:30.777948+0000","last_undegraded":"2023-09-28T00:15:30.777948+0000","last_fullsized":"2023-09-28T00:15:30.777948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.380117+0000","last_change":"2023-09-28T00:15:29.386237+0000","last_active":"2023-09-28T00:15:30.380117+0000","last_peered":"2023-09-28T00:15:30.380117+0000","last_clean":"2023-09-28T00:15:30.380117+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:15:30.380117+0000","last_undegraded":"2023-09-28T00:15:30.380117+0000","last_fullsized":"2023-09-28T00:15:30.380117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777738+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:15:30.777738+0000","last_peered":"2023-09-28T00:15:30.777738+0000","last_clean":"2023-09-28T00:15:30.777738+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:15:30.777738+0000","last_undegraded":"2023-09-28T00:15:30.777738+0000","last_fullsized":"2023-09-28T00:15:30.777738+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394054+0000","last_change":"2023-09-28T00:15:29.392231+0000","last_active":"2023-09-28T00:15:29.394054+0000","last_peered":"2023-09-28T00:15:29.394054+0000","last_clean":"2023-09-28T00:15:29.394054+0000","last_became_active":"2023-09-28T00:15:29.391855+0000","last_became_peered":"2023-09-28T00:15:29.391855+0000","last_unstale":"2023-09-28T00:15:29.394054+0000","last_undegraded":"2023-09-28T00:15:29.394054+0000","last_fullsized":"2023-09-28T00:15:29.394054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:35:30.395503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778557+0000","last_change":"2023-09-28T00:15:29.394242+0000","last_active":"2023-09-28T00:15:30.778557+0000","last_peered":"2023-09-28T00:15:30.778557+0000","last_clean":"2023-09-28T00:15:30.778557+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:15:30.778557+0000","last_undegraded":"2023-09-28T00:15:30.778557+0000","last_fullsized":"2023-09-28T00:15:30.778557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777432+0000","last_change":"2023-09-28T00:15:29.389082+0000","last_active":"2023-09-28T00:15:30.777432+0000","last_peered":"2023-09-28T00:15:30.777432+0000","last_clean":"2023-09-28T00:15:30.777432+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:15:30.777432+0000","last_undegraded":"2023-09-28T00:15:30.777432+0000","last_fullsized":"2023-09-28T00:15:30.777432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.394025+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:15:29.394025+0000","last_peered":"2023-09-28T00:15:29.394025+0000","last_clean":"2023-09-28T00:15:29.394025+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:15:29.394025+0000","last_undegraded":"2023-09-28T00:15:29.394025+0000","last_fullsized":"2023-09-28T00:15:29.394025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:37:26.247755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777946+0000","last_change":"2023-09-28T00:15:29.392586+0000","last_active":"2023-09-28T00:15:30.777946+0000","last_peered":"2023-09-28T00:15:30.777946+0000","last_clean":"2023-09-28T00:15:30.777946+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:15:30.777946+0000","last_undegraded":"2023-09-28T00:15:30.777946+0000","last_fullsized":"2023-09-28T00:15:30.777946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778008+0000","last_change":"2023-09-28T00:15:29.384837+0000","last_active":"2023-09-28T00:15:30.778008+0000","last_peered":"2023-09-28T00:15:30.778008+0000","last_clean":"2023-09-28T00:15:30.778008+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:15:30.778008+0000","last_undegraded":"2023-09-28T00:15:30.778008+0000","last_fullsized":"2023-09-28T00:15:30.778008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593191+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:15:30.593191+0000","last_peered":"2023-09-28T00:15:30.593191+0000","last_clean":"2023-09-28T00:15:30.593191+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:15:30.593191+0000","last_undegraded":"2023-09-28T00:15:30.593191+0000","last_fullsized":"2023-09-28T00:15:30.593191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777590+0000","last_change":"2023-09-28T00:15:28.982899+0000","last_active":"2023-09-28T00:15:30.777590+0000","last_peered":"2023-09-28T00:15:30.777590+0000","last_clean":"2023-09-28T00:15:30.777590+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:15:30.777590+0000","last_undegraded":"2023-09-28T00:15:30.777590+0000","last_fullsized":"2023-09-28T00:15:30.777590+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778179+0000","last_change":"2023-09-28T00:15:29.383398+0000","last_active":"2023-09-28T00:15:30.778179+0000","last_peered":"2023-09-28T00:15:30.778179+0000","last_clean":"2023-09-28T00:15:30.778179+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:15:30.778179+0000","last_undegraded":"2023-09-28T00:15:30.778179+0000","last_fullsized":"2023-09-28T00:15:30.778179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777184+0000","last_change":"2023-09-28T00:15:28.984308+0000","last_active":"2023-09-28T00:15:30.777184+0000","last_peered":"2023-09-28T00:15:30.777184+0000","last_clean":"2023-09-28T00:15:30.777184+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:15:30.777184+0000","last_undegraded":"2023-09-28T00:15:30.777184+0000","last_fullsized":"2023-09-28T00:15:30.777184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778280+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:15:30.778280+0000","last_peered":"2023-09-28T00:15:30.778280+0000","last_clean":"2023-09-28T00:15:30.778280+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:15:30.778280+0000","last_undegraded":"2023-09-28T00:15:30.778280+0000","last_fullsized":"2023-09-28T00:15:30.778280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777756+0000","last_change":"2023-09-28T00:15:28.986600+0000","last_active":"2023-09-28T00:15:30.777756+0000","last_peered":"2023-09-28T00:15:30.777756+0000","last_clean":"2023-09-28T00:15:30.777756+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:15:30.777756+0000","last_undegraded":"2023-09-28T00:15:30.777756+0000","last_fullsized":"2023-09-28T00:15:30.777756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.397007+0000","last_change":"2023-09-28T00:15:29.391209+0000","last_active":"2023-09-28T00:15:29.397007+0000","last_peered":"2023-09-28T00:15:29.397007+0000","last_clean":"2023-09-28T00:15:29.397007+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:15:29.397007+0000","last_undegraded":"2023-09-28T00:15:29.397007+0000","last_fullsized":"2023-09-28T00:15:29.397007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:40:32.316923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778294+0000","last_change":"2023-09-28T00:15:28.990492+0000","last_active":"2023-09-28T00:15:30.778294+0000","last_peered":"2023-09-28T00:15:30.778294+0000","last_clean":"2023-09-28T00:15:30.778294+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:15:30.778294+0000","last_undegraded":"2023-09-28T00:15:30.778294+0000","last_fullsized":"2023-09-28T00:15:30.778294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777673+0000","last_change":"2023-09-28T00:15:29.381022+0000","last_active":"2023-09-28T00:15:30.777673+0000","last_peered":"2023-09-28T00:15:30.777673+0000","last_clean":"2023-09-28T00:15:30.777673+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:15:30.777673+0000","last_undegraded":"2023-09-28T00:15:30.777673+0000","last_fullsized":"2023-09-28T00:15:30.777673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593302+0000","last_change":"2023-09-28T00:15:28.989043+0000","last_active":"2023-09-28T00:15:30.593302+0000","last_peered":"2023-09-28T00:15:30.593302+0000","last_clean":"2023-09-28T00:15:30.593302+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:15:30.593302+0000","last_undegraded":"2023-09-28T00:15:30.593302+0000","last_fullsized":"2023-09-28T00:15:30.593302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777333+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:15:30.777333+0000","last_peered":"2023-09-28T00:15:30.777333+0000","last_clean":"2023-09-28T00:15:30.777333+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:15:30.777333+0000","last_undegraded":"2023-09-28T00:15:30.777333+0000","last_fullsized":"2023-09-28T00:15:30.777333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399129+0000","last_change":"2023-09-28T00:15:28.981865+0000","last_active":"2023-09-28T00:15:29.399129+0000","last_peered":"2023-09-28T00:15:29.399129+0000","last_clean":"2023-09-28T00:15:29.399129+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:15:29.399129+0000","last_undegraded":"2023-09-28T00:15:29.399129+0000","last_fullsized":"2023-09-28T00:15:29.399129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:10.614259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777177+0000","last_change":"2023-09-28T00:15:29.389604+0000","last_active":"2023-09-28T00:15:30.777177+0000","last_peered":"2023-09-28T00:15:30.777177+0000","last_clean":"2023-09-28T00:15:30.777177+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:15:30.777177+0000","last_undegraded":"2023-09-28T00:15:30.777177+0000","last_fullsized":"2023-09-28T00:15:30.777177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777861+0000","last_change":"2023-09-28T00:15:28.979093+0000","last_active":"2023-09-28T00:15:30.777861+0000","last_peered":"2023-09-28T00:15:30.777861+0000","last_clean":"2023-09-28T00:15:30.777861+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:15:30.777861+0000","last_undegraded":"2023-09-28T00:15:30.777861+0000","last_fullsized":"2023-09-28T00:15:30.777861+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777657+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:15:30.777657+0000","last_peered":"2023-09-28T00:15:30.777657+0000","last_clean":"2023-09-28T00:15:30.777657+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:15:30.777657+0000","last_undegraded":"2023-09-28T00:15:30.777657+0000","last_fullsized":"2023-09-28T00:15:30.777657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403068+0000","last_change":"2023-09-28T00:15:28.985348+0000","last_active":"2023-09-28T00:15:29.403068+0000","last_peered":"2023-09-28T00:15:29.403068+0000","last_clean":"2023-09-28T00:15:29.403068+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:15:29.403068+0000","last_undegraded":"2023-09-28T00:15:29.403068+0000","last_fullsized":"2023-09-28T00:15:29.403068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:42.627047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778275+0000","last_change":"2023-09-28T00:15:29.383322+0000","last_active":"2023-09-28T00:15:30.778275+0000","last_peered":"2023-09-28T00:15:30.778275+0000","last_clean":"2023-09-28T00:15:30.778275+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:15:30.778275+0000","last_undegraded":"2023-09-28T00:15:30.778275+0000","last_fullsized":"2023-09-28T00:15:30.778275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:48.623017+0000","last_change":"2023-09-28T00:15:48.622966+0000","last_active":"2023-09-28T00:15:48.623017+0000","last_peered":"2023-09-28T00:15:48.623017+0000","last_clean":"2023-09-28T00:15:48.623017+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:15:48.623017+0000","last_undegraded":"2023-09-28T00:15:48.623017+0000","last_fullsized":"2023-09-28T00:15:48.623017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:48.622809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:48.622809+0000","last_clean_scrub_stamp":"2023-09-28T00:15:48.622809+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:04:59.170139+0000","scrub_duration":0.0017786600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593366+0000","last_change":"2023-09-28T00:15:29.395546+0000","last_active":"2023-09-28T00:15:30.593366+0000","last_peered":"2023-09-28T00:15:30.593366+0000","last_clean":"2023-09-28T00:15:30.593366+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:15:30.593366+0000","last_undegraded":"2023-09-28T00:15:30.593366+0000","last_fullsized":"2023-09-28T00:15:30.593366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380953+0000","last_change":"2023-09-28T00:15:28.985438+0000","last_active":"2023-09-28T00:15:29.380953+0000","last_peered":"2023-09-28T00:15:29.380953+0000","last_clean":"2023-09-28T00:15:29.380953+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:15:29.380953+0000","last_undegraded":"2023-09-28T00:15:29.380953+0000","last_fullsized":"2023-09-28T00:15:29.380953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:07:52.749154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778212+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:15:30.778212+0000","last_peered":"2023-09-28T00:15:30.778212+0000","last_clean":"2023-09-28T00:15:30.778212+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:15:30.778212+0000","last_undegraded":"2023-09-28T00:15:30.778212+0000","last_fullsized":"2023-09-28T00:15:30.778212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403755+0000","last_change":"2023-09-28T00:15:28.983275+0000","last_active":"2023-09-28T00:15:29.403755+0000","last_peered":"2023-09-28T00:15:29.403755+0000","last_clean":"2023-09-28T00:15:29.403755+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:15:29.403755+0000","last_undegraded":"2023-09-28T00:15:29.403755+0000","last_fullsized":"2023-09-28T00:15:29.403755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:10:17.162300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777894+0000","last_change":"2023-09-28T00:15:29.393952+0000","last_active":"2023-09-28T00:15:30.777894+0000","last_peered":"2023-09-28T00:15:30.777894+0000","last_clean":"2023-09-28T00:15:30.777894+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:15:30.777894+0000","last_undegraded":"2023-09-28T00:15:30.777894+0000","last_fullsized":"2023-09-28T00:15:30.777894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402648+0000","last_change":"2023-09-28T00:15:28.986391+0000","last_active":"2023-09-28T00:15:29.402648+0000","last_peered":"2023-09-28T00:15:29.402648+0000","last_clean":"2023-09-28T00:15:29.402648+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:15:29.402648+0000","last_undegraded":"2023-09-28T00:15:29.402648+0000","last_fullsized":"2023-09-28T00:15:29.402648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:38.784605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593320+0000","last_change":"2023-09-28T00:15:29.393474+0000","last_active":"2023-09-28T00:15:30.593320+0000","last_peered":"2023-09-28T00:15:30.593320+0000","last_clean":"2023-09-28T00:15:30.593320+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:15:30.593320+0000","last_undegraded":"2023-09-28T00:15:30.593320+0000","last_fullsized":"2023-09-28T00:15:30.593320+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.402943+0000","last_change":"2023-09-28T00:15:28.986082+0000","last_active":"2023-09-28T00:15:29.402943+0000","last_peered":"2023-09-28T00:15:29.402943+0000","last_clean":"2023-09-28T00:15:29.402943+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:15:29.402943+0000","last_undegraded":"2023-09-28T00:15:29.402943+0000","last_fullsized":"2023-09-28T00:15:29.402943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:16.392360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777524+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:15:30.777524+0000","last_peered":"2023-09-28T00:15:30.777524+0000","last_clean":"2023-09-28T00:15:30.777524+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:15:30.777524+0000","last_undegraded":"2023-09-28T00:15:30.777524+0000","last_fullsized":"2023-09-28T00:15:30.777524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.399248+0000","last_change":"2023-09-28T00:15:28.982433+0000","last_active":"2023-09-28T00:15:29.399248+0000","last_peered":"2023-09-28T00:15:29.399248+0000","last_clean":"2023-09-28T00:15:29.399248+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:15:29.399248+0000","last_undegraded":"2023-09-28T00:15:29.399248+0000","last_fullsized":"2023-09-28T00:15:29.399248+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:37:52.940784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.395572+0000","last_change":"2023-09-28T00:15:29.388766+0000","last_active":"2023-09-28T00:15:29.395572+0000","last_peered":"2023-09-28T00:15:29.395572+0000","last_clean":"2023-09-28T00:15:29.395572+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:15:29.395572+0000","last_undegraded":"2023-09-28T00:15:29.395572+0000","last_fullsized":"2023-09-28T00:15:29.395572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:07:43.634742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593233+0000","last_change":"2023-09-28T00:15:28.984089+0000","last_active":"2023-09-28T00:15:30.593233+0000","last_peered":"2023-09-28T00:15:30.593233+0000","last_clean":"2023-09-28T00:15:30.593233+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:15:30.593233+0000","last_undegraded":"2023-09-28T00:15:30.593233+0000","last_fullsized":"2023-09-28T00:15:30.593233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.779168+0000","last_change":"2023-09-28T00:15:29.386850+0000","last_active":"2023-09-28T00:15:30.779168+0000","last_peered":"2023-09-28T00:15:30.779168+0000","last_clean":"2023-09-28T00:15:30.779168+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:15:30.779168+0000","last_undegraded":"2023-09-28T00:15:30.779168+0000","last_fullsized":"2023-09-28T00:15:30.779168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777823+0000","last_change":"2023-09-28T00:15:28.986069+0000","last_active":"2023-09-28T00:15:30.777823+0000","last_peered":"2023-09-28T00:15:30.777823+0000","last_clean":"2023-09-28T00:15:30.777823+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:15:30.777823+0000","last_undegraded":"2023-09-28T00:15:30.777823+0000","last_fullsized":"2023-09-28T00:15:30.777823+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777779+0000","last_change":"2023-09-28T00:15:29.393182+0000","last_active":"2023-09-28T00:15:30.777779+0000","last_peered":"2023-09-28T00:15:30.777779+0000","last_clean":"2023-09-28T00:15:30.777779+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:15:30.777779+0000","last_undegraded":"2023-09-28T00:15:30.777779+0000","last_fullsized":"2023-09-28T00:15:30.777779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385144+0000","last_change":"2023-09-28T00:15:28.985291+0000","last_active":"2023-09-28T00:15:29.385144+0000","last_peered":"2023-09-28T00:15:29.385144+0000","last_clean":"2023-09-28T00:15:29.385144+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:15:29.385144+0000","last_undegraded":"2023-09-28T00:15:29.385144+0000","last_fullsized":"2023-09-28T00:15:29.385144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:03:30.956837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777952+0000","last_change":"2023-09-28T00:15:29.400083+0000","last_active":"2023-09-28T00:15:30.777952+0000","last_peered":"2023-09-28T00:15:30.777952+0000","last_clean":"2023-09-28T00:15:30.777952+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:15:30.777952+0000","last_undegraded":"2023-09-28T00:15:30.777952+0000","last_fullsized":"2023-09-28T00:15:30.777952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777696+0000","last_change":"2023-09-28T00:15:28.980715+0000","last_active":"2023-09-28T00:15:30.777696+0000","last_peered":"2023-09-28T00:15:30.777696+0000","last_clean":"2023-09-28T00:15:30.777696+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:15:30.777696+0000","last_undegraded":"2023-09-28T00:15:30.777696+0000","last_fullsized":"2023-09-28T00:15:30.777696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778028+0000","last_change":"2023-09-28T00:15:29.397875+0000","last_active":"2023-09-28T00:15:30.778028+0000","last_peered":"2023-09-28T00:15:30.778028+0000","last_clean":"2023-09-28T00:15:30.778028+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:15:30.778028+0000","last_undegraded":"2023-09-28T00:15:30.778028+0000","last_fullsized":"2023-09-28T00:15:30.778028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777576+0000","last_change":"2023-09-28T00:15:28.986410+0000","last_active":"2023-09-28T00:15:30.777576+0000","last_peered":"2023-09-28T00:15:30.777576+0000","last_clean":"2023-09-28T00:15:30.777576+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:15:30.777576+0000","last_undegraded":"2023-09-28T00:15:30.777576+0000","last_fullsized":"2023-09-28T00:15:30.777576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778158+0000","last_change":"2023-09-28T00:15:29.392748+0000","last_active":"2023-09-28T00:15:30.778158+0000","last_peered":"2023-09-28T00:15:30.778158+0000","last_clean":"2023-09-28T00:15:30.778158+0000","last_became_active":"2023-09-28T00:15:29.392336+0000","last_became_peered":"2023-09-28T00:15:29.392336+0000","last_unstale":"2023-09-28T00:15:30.778158+0000","last_undegraded":"2023-09-28T00:15:30.778158+0000","last_fullsized":"2023-09-28T00:15:30.778158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:48.686415+0000","last_change":"2023-09-28T00:15:48.686393+0000","last_active":"2023-09-28T00:15:48.686415+0000","last_peered":"2023-09-28T00:15:48.686415+0000","last_clean":"2023-09-28T00:15:48.686415+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:15:48.686415+0000","last_undegraded":"2023-09-28T00:15:48.686415+0000","last_fullsized":"2023-09-28T00:15:48.686415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:48.686304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:48.686304+0000","last_clean_scrub_stamp":"2023-09-28T00:15:48.686304+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:37.583686+0000","scrub_duration":0.0013027640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593377+0000","last_change":"2023-09-28T00:15:28.986194+0000","last_active":"2023-09-28T00:15:30.593377+0000","last_peered":"2023-09-28T00:15:30.593377+0000","last_clean":"2023-09-28T00:15:30.593377+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:15:30.593377+0000","last_undegraded":"2023-09-28T00:15:30.593377+0000","last_fullsized":"2023-09-28T00:15:30.593377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777270+0000","last_change":"2023-09-28T00:15:29.388604+0000","last_active":"2023-09-28T00:15:30.777270+0000","last_peered":"2023-09-28T00:15:30.777270+0000","last_clean":"2023-09-28T00:15:30.777270+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:15:30.777270+0000","last_undegraded":"2023-09-28T00:15:30.777270+0000","last_fullsized":"2023-09-28T00:15:30.777270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593337+0000","last_change":"2023-09-28T00:15:23.950475+0000","last_active":"2023-09-28T00:15:30.593337+0000","last_peered":"2023-09-28T00:15:30.593337+0000","last_clean":"2023-09-28T00:15:30.593337+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:15:30.593337+0000","last_undegraded":"2023-09-28T00:15:30.593337+0000","last_fullsized":"2023-09-28T00:15:30.593337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777685+0000","last_change":"2023-09-28T00:15:28.984604+0000","last_active":"2023-09-28T00:15:30.777685+0000","last_peered":"2023-09-28T00:15:30.777685+0000","last_clean":"2023-09-28T00:15:30.777685+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:15:30.777685+0000","last_undegraded":"2023-09-28T00:15:30.777685+0000","last_fullsized":"2023-09-28T00:15:30.777685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777625+0000","last_change":"2023-09-28T00:15:29.392616+0000","last_active":"2023-09-28T00:15:30.777625+0000","last_peered":"2023-09-28T00:15:30.777625+0000","last_clean":"2023-09-28T00:15:30.777625+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:15:30.777625+0000","last_undegraded":"2023-09-28T00:15:30.777625+0000","last_fullsized":"2023-09-28T00:15:30.777625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:49.304738+0000","last_change":"2023-09-28T00:15:49.304707+0000","last_active":"2023-09-28T00:15:49.304738+0000","last_peered":"2023-09-28T00:15:49.304738+0000","last_clean":"2023-09-28T00:15:49.304738+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:15:49.304738+0000","last_undegraded":"2023-09-28T00:15:49.304738+0000","last_fullsized":"2023-09-28T00:15:49.304738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:49.304605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:49.304605+0000","last_clean_scrub_stamp":"2023-09-28T00:15:49.304605+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:31.322663+0000","scrub_duration":0.0012867289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777001+0000","last_change":"2023-09-28T00:15:28.980294+0000","last_active":"2023-09-28T00:15:30.777001+0000","last_peered":"2023-09-28T00:15:30.777001+0000","last_clean":"2023-09-28T00:15:30.777001+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:15:30.777001+0000","last_undegraded":"2023-09-28T00:15:30.777001+0000","last_fullsized":"2023-09-28T00:15:30.777001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778062+0000","last_change":"2023-09-28T00:15:29.388008+0000","last_active":"2023-09-28T00:15:30.778062+0000","last_peered":"2023-09-28T00:15:30.778062+0000","last_clean":"2023-09-28T00:15:30.778062+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:15:30.778062+0000","last_undegraded":"2023-09-28T00:15:30.778062+0000","last_fullsized":"2023-09-28T00:15:30.778062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593198+0000","last_change":"2023-09-28T00:15:23.950457+0000","last_active":"2023-09-28T00:15:30.593198+0000","last_peered":"2023-09-28T00:15:30.593198+0000","last_clean":"2023-09-28T00:15:30.593198+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:15:30.593198+0000","last_undegraded":"2023-09-28T00:15:30.593198+0000","last_fullsized":"2023-09-28T00:15:30.593198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380256+0000","last_change":"2023-09-28T00:15:16.995081+0000","last_active":"2023-09-28T00:15:29.380256+0000","last_peered":"2023-09-28T00:15:29.380256+0000","last_clean":"2023-09-28T00:15:29.380256+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:15:29.380256+0000","last_undegraded":"2023-09-28T00:15:29.380256+0000","last_fullsized":"2023-09-28T00:15:29.380256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:15.867916+0000","last_clean_scrub_stamp":"2023-09-28T00:15:15.867916+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:37:49.633249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777858+0000","last_change":"2023-09-28T00:15:28.985016+0000","last_active":"2023-09-28T00:15:30.777858+0000","last_peered":"2023-09-28T00:15:30.777858+0000","last_clean":"2023-09-28T00:15:30.777858+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:15:30.777858+0000","last_undegraded":"2023-09-28T00:15:30.777858+0000","last_fullsized":"2023-09-28T00:15:30.777858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.403095+0000","last_change":"2023-09-28T00:15:29.401863+0000","last_active":"2023-09-28T00:15:29.403095+0000","last_peered":"2023-09-28T00:15:29.403095+0000","last_clean":"2023-09-28T00:15:29.403095+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:15:29.403095+0000","last_undegraded":"2023-09-28T00:15:29.403095+0000","last_fullsized":"2023-09-28T00:15:29.403095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:30:17.400054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.380675+0000","last_change":"2023-09-28T00:15:23.946737+0000","last_active":"2023-09-28T00:15:29.380675+0000","last_peered":"2023-09-28T00:15:29.380675+0000","last_clean":"2023-09-28T00:15:29.380675+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:15:29.380675+0000","last_undegraded":"2023-09-28T00:15:29.380675+0000","last_fullsized":"2023-09-28T00:15:29.380675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:46:53.587088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778379+0000","last_change":"2023-09-28T00:15:28.986464+0000","last_active":"2023-09-28T00:15:30.778379+0000","last_peered":"2023-09-28T00:15:30.778379+0000","last_clean":"2023-09-28T00:15:30.778379+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:15:30.778379+0000","last_undegraded":"2023-09-28T00:15:30.778379+0000","last_fullsized":"2023-09-28T00:15:30.778379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778391+0000","last_change":"2023-09-28T00:15:29.390313+0000","last_active":"2023-09-28T00:15:30.778391+0000","last_peered":"2023-09-28T00:15:30.778391+0000","last_clean":"2023-09-28T00:15:30.778391+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:15:30.778391+0000","last_undegraded":"2023-09-28T00:15:30.778391+0000","last_fullsized":"2023-09-28T00:15:30.778391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.379277+0000","last_change":"2023-09-28T00:15:24.193260+0000","last_active":"2023-09-28T00:15:29.379277+0000","last_peered":"2023-09-28T00:15:29.379277+0000","last_clean":"2023-09-28T00:15:29.379277+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:15:29.379277+0000","last_undegraded":"2023-09-28T00:15:29.379277+0000","last_fullsized":"2023-09-28T00:15:29.379277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:44:40.757939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777700+0000","last_change":"2023-09-28T00:15:28.979725+0000","last_active":"2023-09-28T00:15:30.777700+0000","last_peered":"2023-09-28T00:15:30.777700+0000","last_clean":"2023-09-28T00:15:30.777700+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:15:30.777700+0000","last_undegraded":"2023-09-28T00:15:30.777700+0000","last_fullsized":"2023-09-28T00:15:30.777700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.779031+0000","last_change":"2023-09-28T00:15:29.398984+0000","last_active":"2023-09-28T00:15:30.779031+0000","last_peered":"2023-09-28T00:15:30.779031+0000","last_clean":"2023-09-28T00:15:30.779031+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:15:30.779031+0000","last_undegraded":"2023-09-28T00:15:30.779031+0000","last_fullsized":"2023-09-28T00:15:30.779031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777785+0000","last_change":"2023-09-28T00:15:28.989236+0000","last_active":"2023-09-28T00:15:30.777785+0000","last_peered":"2023-09-28T00:15:30.777785+0000","last_clean":"2023-09-28T00:15:30.777785+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:15:30.777785+0000","last_undegraded":"2023-09-28T00:15:30.777785+0000","last_fullsized":"2023-09-28T00:15:30.777785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778043+0000","last_change":"2023-09-28T00:15:23.949425+0000","last_active":"2023-09-28T00:15:30.778043+0000","last_peered":"2023-09-28T00:15:30.778043+0000","last_clean":"2023-09-28T00:15:30.778043+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:15:30.778043+0000","last_undegraded":"2023-09-28T00:15:30.778043+0000","last_fullsized":"2023-09-28T00:15:30.778043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777492+0000","last_change":"2023-09-28T00:15:29.386508+0000","last_active":"2023-09-28T00:15:30.777492+0000","last_peered":"2023-09-28T00:15:30.777492+0000","last_clean":"2023-09-28T00:15:30.777492+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:15:30.777492+0000","last_undegraded":"2023-09-28T00:15:30.777492+0000","last_fullsized":"2023-09-28T00:15:30.777492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.385234+0000","last_change":"2023-09-28T00:15:23.949692+0000","last_active":"2023-09-28T00:15:29.385234+0000","last_peered":"2023-09-28T00:15:29.385234+0000","last_clean":"2023-09-28T00:15:29.385234+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:15:29.385234+0000","last_undegraded":"2023-09-28T00:15:29.385234+0000","last_fullsized":"2023-09-28T00:15:29.385234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:22.932404+0000","last_clean_scrub_stamp":"2023-09-28T00:15:22.932404+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:48:11.275095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:34.057378+0000","last_change":"2023-09-28T00:15:28.988077+0000","last_active":"2023-09-28T00:15:34.057378+0000","last_peered":"2023-09-28T00:15:34.057378+0000","last_clean":"2023-09-28T00:15:34.057378+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:15:34.057378+0000","last_undegraded":"2023-09-28T00:15:34.057378+0000","last_fullsized":"2023-09-28T00:15:34.057378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777510+0000","last_change":"2023-09-28T00:15:29.398170+0000","last_active":"2023-09-28T00:15:30.777510+0000","last_peered":"2023-09-28T00:15:30.777510+0000","last_clean":"2023-09-28T00:15:30.777510+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:15:30.777510+0000","last_undegraded":"2023-09-28T00:15:30.777510+0000","last_fullsized":"2023-09-28T00:15:30.777510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.779082+0000","last_change":"2023-09-28T00:15:28.987224+0000","last_active":"2023-09-28T00:15:30.779082+0000","last_peered":"2023-09-28T00:15:30.779082+0000","last_clean":"2023-09-28T00:15:30.779082+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:15:30.779082+0000","last_undegraded":"2023-09-28T00:15:30.779082+0000","last_fullsized":"2023-09-28T00:15:30.779082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.380154+0000","last_change":"2023-09-28T00:15:29.383759+0000","last_active":"2023-09-28T00:15:30.380154+0000","last_peered":"2023-09-28T00:15:30.380154+0000","last_clean":"2023-09-28T00:15:30.380154+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:15:30.380154+0000","last_undegraded":"2023-09-28T00:15:30.380154+0000","last_fullsized":"2023-09-28T00:15:30.380154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593167+0000","last_change":"2023-09-28T00:15:28.987633+0000","last_active":"2023-09-28T00:15:30.593167+0000","last_peered":"2023-09-28T00:15:30.593167+0000","last_clean":"2023-09-28T00:15:30.593167+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:15:30.593167+0000","last_undegraded":"2023-09-28T00:15:30.593167+0000","last_fullsized":"2023-09-28T00:15:30.593167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777846+0000","last_change":"2023-09-28T00:15:29.392897+0000","last_active":"2023-09-28T00:15:30.777846+0000","last_peered":"2023-09-28T00:15:30.777846+0000","last_clean":"2023-09-28T00:15:30.777846+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:15:30.777846+0000","last_undegraded":"2023-09-28T00:15:30.777846+0000","last_fullsized":"2023-09-28T00:15:30.777846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.593480+0000","last_change":"2023-09-28T00:15:28.987962+0000","last_active":"2023-09-28T00:15:30.593480+0000","last_peered":"2023-09-28T00:15:30.593480+0000","last_clean":"2023-09-28T00:15:30.593480+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:15:30.593480+0000","last_undegraded":"2023-09-28T00:15:30.593480+0000","last_fullsized":"2023-09-28T00:15:30.593480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777732+0000","last_change":"2023-09-28T00:15:29.394598+0000","last_active":"2023-09-28T00:15:30.777732+0000","last_peered":"2023-09-28T00:15:30.777732+0000","last_clean":"2023-09-28T00:15:30.777732+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:15:30.777732+0000","last_undegraded":"2023-09-28T00:15:30.777732+0000","last_fullsized":"2023-09-28T00:15:30.777732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777218+0000","last_change":"2023-09-28T00:15:28.983686+0000","last_active":"2023-09-28T00:15:30.777218+0000","last_peered":"2023-09-28T00:15:30.777218+0000","last_clean":"2023-09-28T00:15:30.777218+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:15:30.777218+0000","last_undegraded":"2023-09-28T00:15:30.777218+0000","last_fullsized":"2023-09-28T00:15:30.777218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777317+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:15:30.777317+0000","last_peered":"2023-09-28T00:15:30.777317+0000","last_clean":"2023-09-28T00:15:30.777317+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:15:30.777317+0000","last_undegraded":"2023-09-28T00:15:30.777317+0000","last_fullsized":"2023-09-28T00:15:30.777317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778352+0000","last_change":"2023-09-28T00:15:28.985280+0000","last_active":"2023-09-28T00:15:30.778352+0000","last_peered":"2023-09-28T00:15:30.778352+0000","last_clean":"2023-09-28T00:15:30.778352+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:15:30.778352+0000","last_undegraded":"2023-09-28T00:15:30.778352+0000","last_fullsized":"2023-09-28T00:15:30.778352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777395+0000","last_change":"2023-09-28T00:15:29.398360+0000","last_active":"2023-09-28T00:15:30.777395+0000","last_peered":"2023-09-28T00:15:30.777395+0000","last_clean":"2023-09-28T00:15:30.777395+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:15:30.777395+0000","last_undegraded":"2023-09-28T00:15:30.777395+0000","last_fullsized":"2023-09-28T00:15:30.777395+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-09-28T00:15:29.400854+0000","last_change":"2023-09-28T00:15:29.395080+0000","last_active":"2023-09-28T00:15:29.400854+0000","last_peered":"2023-09-28T00:15:29.400854+0000","last_clean":"2023-09-28T00:15:29.400854+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:15:29.400854+0000","last_undegraded":"2023-09-28T00:15:29.400854+0000","last_fullsized":"2023-09-28T00:15:29.400854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:08:39.792299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777241+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:15:30.777241+0000","last_peered":"2023-09-28T00:15:30.777241+0000","last_clean":"2023-09-28T00:15:30.777241+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:15:30.777241+0000","last_undegraded":"2023-09-28T00:15:30.777241+0000","last_fullsized":"2023-09-28T00:15:30.777241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777528+0000","last_change":"2023-09-28T00:15:29.399203+0000","last_active":"2023-09-28T00:15:30.777528+0000","last_peered":"2023-09-28T00:15:30.777528+0000","last_clean":"2023-09-28T00:15:30.777528+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:15:30.777528+0000","last_undegraded":"2023-09-28T00:15:30.777528+0000","last_fullsized":"2023-09-28T00:15:30.777528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777725+0000","last_change":"2023-09-28T00:15:29.388644+0000","last_active":"2023-09-28T00:15:30.777725+0000","last_peered":"2023-09-28T00:15:30.777725+0000","last_clean":"2023-09-28T00:15:30.777725+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:15:30.777725+0000","last_undegraded":"2023-09-28T00:15:30.777725+0000","last_fullsized":"2023-09-28T00:15:30.777725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777452+0000","last_change":"2023-09-28T00:15:29.388432+0000","last_active":"2023-09-28T00:15:30.777452+0000","last_peered":"2023-09-28T00:15:30.777452+0000","last_clean":"2023-09-28T00:15:30.777452+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:15:30.777452+0000","last_undegraded":"2023-09-28T00:15:30.777452+0000","last_fullsized":"2023-09-28T00:15:30.777452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8004,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363836,"statfs":{"total":96636764160,"available":96628568064,"internally_reserved":0,"allocated":258048,"data_stored":93762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9092,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362748,"statfs":{"total":96636764160,"available":96627453952,"internally_reserved":0,"allocated":847872,"data_stored":684060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9116,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362724,"statfs":{"total":96636764160,"available":96627429376,"internally_reserved":0,"allocated":872448,"data_stored":685258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7932,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363908,"statfs":{"total":96636764160,"available":96628641792,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":93228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542156,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":270336,"data_stored":94730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:15:51.869 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.869 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.869 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.869 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.870 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.870 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.870 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.870 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.870 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.870 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.871 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.871 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.871 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.871 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.871 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.871 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.872 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.872 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.872 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.872 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.872 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.872 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.873 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.873 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.873 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.873 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.873 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.873 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.874 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.874 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.874 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.874 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.874 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.875 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.875 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.875 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.875 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.875 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.875 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.876 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.876 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.876 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.876 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.876 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.876 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.877 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.877 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.877 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.877 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.877 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.877 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.878 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.878 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.878 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.878 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.878 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.878 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.879 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.879 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.879 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.879 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.879 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.879 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.880 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.880 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.880 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.880 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-28T00:15:22.932404+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=22, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.880 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.880 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.881 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.881 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.881 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-28T00:15:22.932404+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=22, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.881 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-28T00:15:15.867916+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=15, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.881 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.882 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.882 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-28T00:15:22.932404+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=22, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.882 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.882 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.882 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-28T00:15:22.932404+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=22, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.882 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.883 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.883 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.883 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-28T00:15:22.932404+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=22, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.883 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.883 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-28T00:15:22.932404+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=22, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.883 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.884 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.884 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.884 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.884 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.884 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.884 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.885 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.885 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.885 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.885 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.885 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.885 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.886 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.886 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.886 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.886 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:15:51.886 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T00:16:00.211 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:16:00.214 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:16:11.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:16:12.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.020+0000 7fda294c8700 1 Processor -- start 2023-09-28T00:16:12.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.020+0000 7fda294c8700 1 -- start start 2023-09-28T00:16:12.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda294c8700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fda2415d560 0x7fda240d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:12.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda294c8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda2415d930 0x7fda240b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:12.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda294c8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda241591b0 0x7fda24159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:12.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda294c8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240b2ad0 con 0x7fda241591b0 2023-09-28T00:16:12.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda294c8700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda240b4160 con 0x7fda2415d560 2023-09-28T00:16:12.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda294c8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda240b1f80 con 0x7fda2415d930 2023-09-28T00:16:12.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda237fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda241591b0 0x7fda24159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:12.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda237fe700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda241591b0 0x7fda24159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56120/0 (socket says 172.21.15.26:56120) 2023-09-28T00:16:12.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda237fe700 1 -- 172.21.15.26:0/2108321454 learned_addr learned my addr 172.21.15.26:0/2108321454 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:12.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda227fc700 1 --2- 172.21.15.26:0/2108321454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda2415d930 0x7fda240b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:12.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.021+0000 7fda22ffd700 1 --2- 172.21.15.26:0/2108321454 >> v2:172.21.15.190:3300/0 conn(0x7fda2415d560 0x7fda240d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:12.028 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.022+0000 7fda237fe700 1 -- 172.21.15.26:0/2108321454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda2415d930 msgr2=0x7fda240b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:12.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.022+0000 7fda237fe700 1 --2- 172.21.15.26:0/2108321454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda2415d930 0x7fda240b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.022+0000 7fda237fe700 1 -- 172.21.15.26:0/2108321454 >> v2:172.21.15.190:3300/0 conn(0x7fda2415d560 msgr2=0x7fda240d0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:12.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.022+0000 7fda237fe700 1 --2- 172.21.15.26:0/2108321454 >> v2:172.21.15.190:3300/0 conn(0x7fda2415d560 0x7fda240d0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.022+0000 7fda237fe700 1 -- 172.21.15.26:0/2108321454 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda24159b70 con 0x7fda241591b0 2023-09-28T00:16:12.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.022+0000 7fda237fe700 1 --2- 172.21.15.26:0/2108321454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda241591b0 0x7fda24159630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0099b0 tx=0x7fda1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a7b22bd4a97db3 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:12.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.022+0000 7fda21ffb700 1 -- 172.21.15.26:0/2108321454 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00b640 con 0x7fda241591b0 2023-09-28T00:16:12.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.022+0000 7fda21ffb700 1 -- 172.21.15.26:0/2108321454 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c00b7a0 con 0x7fda241591b0 2023-09-28T00:16:12.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.022+0000 7fda21ffb700 1 -- 172.21.15.26:0/2108321454 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00bb40 con 0x7fda241591b0 2023-09-28T00:16:12.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.023+0000 7fda294c8700 1 -- 172.21.15.26:0/2108321454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda241591b0 msgr2=0x7fda24159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:12.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.023+0000 7fda294c8700 1 --2- 172.21.15.26:0/2108321454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda241591b0 0x7fda24159630 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0099b0 tx=0x7fda1c009250 comp rx=0 tx=0).stop 2023-09-28T00:16:12.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.023+0000 7fda294c8700 1 -- 172.21.15.26:0/2108321454 shutdown_connections 2023-09-28T00:16:12.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.023+0000 7fda294c8700 1 --2- 172.21.15.26:0/2108321454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda241591b0 0x7fda24159630 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.023+0000 7fda294c8700 1 --2- 172.21.15.26:0/2108321454 >> v2:172.21.15.190:3300/0 conn(0x7fda2415d560 0x7fda240d0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.023+0000 7fda294c8700 1 --2- 172.21.15.26:0/2108321454 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda2415d930 0x7fda240b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.023+0000 7fda294c8700 1 -- 172.21.15.26:0/2108321454 >> 172.21.15.26:0/2108321454 conn(0x7fda240d1180 msgr2=0x7fda24069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.023+0000 7fda294c8700 1 -- 172.21.15.26:0/2108321454 shutdown_connections 2023-09-28T00:16:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.023+0000 7fda294c8700 1 -- 172.21.15.26:0/2108321454 wait complete. 2023-09-28T00:16:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.024+0000 7fda294c8700 1 Processor -- start 2023-09-28T00:16:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.024+0000 7fda294c8700 1 -- start start 2023-09-28T00:16:12.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda294c8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda241591b0 0x7fda240a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:12.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda294c8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda2415d560 0x7fda2416a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:12.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda294c8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda2415d930 0x7fda240b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:12.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda294c8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2416a1d0 con 0x7fda2415d930 2023-09-28T00:16:12.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda294c8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda240a6f70 con 0x7fda2415d560 2023-09-28T00:16:12.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda294c8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda240a7250 con 0x7fda241591b0 2023-09-28T00:16:12.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda2415d930 0x7fda240b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda2415d930 0x7fda240b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56134/0 (socket says 172.21.15.26:56134) 2023-09-28T00:16:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda237fe700 1 -- 172.21.15.26:0/14471885 learned_addr learned my addr 172.21.15.26:0/14471885 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda227fc700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda2415d560 0x7fda2416a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda22ffd700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda241591b0 0x7fda240a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda237fe700 1 -- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda241591b0 msgr2=0x7fda240a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:12.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda237fe700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda241591b0 0x7fda240a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda237fe700 1 -- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda2415d560 msgr2=0x7fda2416a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:12.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda237fe700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda2415d560 0x7fda2416a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.025+0000 7fda237fe700 1 -- 172.21.15.26:0/14471885 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c0094f0 con 0x7fda2415d930 2023-09-28T00:16:12.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.026+0000 7fda237fe700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda2415d930 0x7fda240b55a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0094c0 tx=0x7fda1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:12.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.027+0000 7fda1affd700 1 -- 172.21.15.26:0/14471885 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00b910 con 0x7fda2415d930 2023-09-28T00:16:12.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.027+0000 7fda1affd700 1 -- 172.21.15.26:0/14471885 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c00ba70 con 0x7fda2415d930 2023-09-28T00:16:12.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.027+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda240a7530 con 0x7fda2415d930 2023-09-28T00:16:12.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.027+0000 7fda1affd700 1 -- 172.21.15.26:0/14471885 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c025670 con 0x7fda2415d930 2023-09-28T00:16:12.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.027+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda240aa050 con 0x7fda2415d930 2023-09-28T00:16:12.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.028+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda240a7a50 con 0x7fda2415d930 2023-09-28T00:16:12.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.028+0000 7fda1affd700 1 -- 172.21.15.26:0/14471885 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fda1c023070 con 0x7fda2415d930 2023-09-28T00:16:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.029+0000 7fda1affd700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fda04067330 0x7fda040697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.029+0000 7fda1affd700 1 -- 172.21.15.26:0/14471885 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fda1c085b90 con 0x7fda2415d930 2023-09-28T00:16:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.029+0000 7fda22ffd700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fda04067330 0x7fda040697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.029+0000 7fda22ffd700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fda04067330 0x7fda040697e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda14009fd0 tx=0x7fda1400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:12.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.035+0000 7fda1affd700 1 -- 172.21.15.26:0/14471885 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fda240a7a50 con 0x7fda2415d930 2023-09-28T00:16:12.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.224+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda240a70e0 con 0x7fda04067330 2023-09-28T00:16:12.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.233+0000 7fda1affd700 1 -- 172.21.15.26:0/14471885 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283429 (secure 0 0 0) 0x7fda240a70e0 con 0x7fda04067330 2023-09-28T00:16:12.237 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:16:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fda04067330 msgr2=0x7fda040697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fda04067330 0x7fda040697e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fda14009fd0 tx=0x7fda1400b040 comp rx=0 tx=0).stop 2023-09-28T00:16:12.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda2415d930 msgr2=0x7fda240b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda2415d930 0x7fda240b55a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0094c0 tx=0x7fda1c017000 comp rx=0 tx=0).stop 2023-09-28T00:16:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 shutdown_connections 2023-09-28T00:16:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fda04067330 0x7fda040697e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fda241591b0 0x7fda240a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda2415d930 0x7fda240b55a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 --2- 172.21.15.26:0/14471885 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fda2415d560 0x7fda2416a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 >> 172.21.15.26:0/14471885 conn(0x7fda240d1180 msgr2=0x7fda24067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:12.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 shutdown_connections 2023-09-28T00:16:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:12.236+0000 7fda294c8700 1 -- 172.21.15.26:0/14471885 wait complete. 2023-09-28T00:16:12.241 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:16:12.248 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2023-09-28T00:16:11.678032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66624,"kb_used_data":3200,"kb_used_omap":0,"kb_used_meta":63360,"kb_avail":754908096,"statfs":{"total":773094113280,"available":773025890304,"internally_reserved":0,"allocated":3276800,"data_stored":1943184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64880640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001766"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:56.267905+0000","last_change":"2023-09-28T00:15:56.267872+0000","last_active":"2023-09-28T00:15:56.267905+0000","last_peered":"2023-09-28T00:15:56.267905+0000","last_clean":"2023-09-28T00:15:56.267905+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:15:56.267905+0000","last_undegraded":"2023-09-28T00:15:56.267905+0000","last_fullsized":"2023-09-28T00:15:56.267905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:56.267743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:56.267743+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.267743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:45.165125+0000","scrub_duration":0.0017700940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.514838+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:15:50.514838+0000","last_peered":"2023-09-28T00:15:50.514838+0000","last_clean":"2023-09-28T00:15:50.514838+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:15:50.514838+0000","last_undegraded":"2023-09-28T00:15:50.514838+0000","last_fullsized":"2023-09-28T00:15:50.514838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017919+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:15:50.017919+0000","last_peered":"2023-09-28T00:15:50.017919+0000","last_clean":"2023-09-28T00:15:50.017919+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:15:50.017919+0000","last_undegraded":"2023-09-28T00:15:50.017919+0000","last_fullsized":"2023-09-28T00:15:50.017919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:51.010218+0000","last_change":"2023-09-28T00:15:29.387338+0000","last_active":"2023-09-28T00:15:51.010218+0000","last_peered":"2023-09-28T00:15:51.010218+0000","last_clean":"2023-09-28T00:15:51.010218+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:15:51.010218+0000","last_undegraded":"2023-09-28T00:15:51.010218+0000","last_fullsized":"2023-09-28T00:15:51.010218+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778977+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:15:30.778977+0000","last_peered":"2023-09-28T00:15:30.778977+0000","last_clean":"2023-09-28T00:15:30.778977+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:15:30.778977+0000","last_undegraded":"2023-09-28T00:15:30.778977+0000","last_fullsized":"2023-09-28T00:15:30.778977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017894+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:15:50.017894+0000","last_peered":"2023-09-28T00:15:50.017894+0000","last_clean":"2023-09-28T00:15:50.017894+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:15:50.017894+0000","last_undegraded":"2023-09-28T00:15:50.017894+0000","last_fullsized":"2023-09-28T00:15:50.017894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.381812+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:15:30.381812+0000","last_peered":"2023-09-28T00:15:30.381812+0000","last_clean":"2023-09-28T00:15:30.381812+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:15:30.381812+0000","last_undegraded":"2023-09-28T00:15:30.381812+0000","last_fullsized":"2023-09-28T00:15:30.381812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.514778+0000","last_change":"2023-09-28T00:15:29.398742+0000","last_active":"2023-09-28T00:15:50.514778+0000","last_peered":"2023-09-28T00:15:50.514778+0000","last_clean":"2023-09-28T00:15:50.514778+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:15:50.514778+0000","last_undegraded":"2023-09-28T00:15:50.514778+0000","last_fullsized":"2023-09-28T00:15:50.514778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778184+0000","last_change":"2023-09-28T00:15:29.401666+0000","last_active":"2023-09-28T00:15:30.778184+0000","last_peered":"2023-09-28T00:15:30.778184+0000","last_clean":"2023-09-28T00:15:30.778184+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:15:30.778184+0000","last_undegraded":"2023-09-28T00:15:30.778184+0000","last_fullsized":"2023-09-28T00:15:30.778184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.514802+0000","last_change":"2023-09-28T00:15:29.388253+0000","last_active":"2023-09-28T00:15:50.514802+0000","last_peered":"2023-09-28T00:15:50.514802+0000","last_clean":"2023-09-28T00:15:50.514802+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:15:50.514802+0000","last_undegraded":"2023-09-28T00:15:50.514802+0000","last_fullsized":"2023-09-28T00:15:50.514802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017897+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:15:50.017897+0000","last_peered":"2023-09-28T00:15:50.017897+0000","last_clean":"2023-09-28T00:15:50.017897+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:15:50.017897+0000","last_undegraded":"2023-09-28T00:15:50.017897+0000","last_fullsized":"2023-09-28T00:15:50.017897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:54.316565+0000","last_change":"2023-09-28T00:15:54.316536+0000","last_active":"2023-09-28T00:15:54.316565+0000","last_peered":"2023-09-28T00:15:54.316565+0000","last_clean":"2023-09-28T00:15:54.316565+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:15:54.316565+0000","last_undegraded":"2023-09-28T00:15:54.316565+0000","last_fullsized":"2023-09-28T00:15:54.316565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:54.316397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:54.316397+0000","last_clean_scrub_stamp":"2023-09-28T00:15:54.316397+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:49:16.409521+0000","scrub_duration":0.002011128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:51.344227+0000","last_change":"2023-09-28T00:15:51.344205+0000","last_active":"2023-09-28T00:15:51.344227+0000","last_peered":"2023-09-28T00:15:51.344227+0000","last_clean":"2023-09-28T00:15:51.344227+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:15:51.344227+0000","last_undegraded":"2023-09-28T00:15:51.344227+0000","last_fullsized":"2023-09-28T00:15:51.344227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:51.344105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:51.344105+0000","last_clean_scrub_stamp":"2023-09-28T00:15:51.344105+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:59.963637+0000","scrub_duration":0.001439826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.514719+0000","last_change":"2023-09-28T00:15:29.394175+0000","last_active":"2023-09-28T00:15:50.514719+0000","last_peered":"2023-09-28T00:15:50.514719+0000","last_clean":"2023-09-28T00:15:50.514719+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:15:50.514719+0000","last_undegraded":"2023-09-28T00:15:50.514719+0000","last_fullsized":"2023-09-28T00:15:50.514719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.382007+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:15:30.382007+0000","last_peered":"2023-09-28T00:15:30.382007+0000","last_clean":"2023-09-28T00:15:30.382007+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:15:30.382007+0000","last_undegraded":"2023-09-28T00:15:30.382007+0000","last_fullsized":"2023-09-28T00:15:30.382007+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:58.202984+0000","last_change":"2023-09-28T00:15:58.202941+0000","last_active":"2023-09-28T00:15:58.202984+0000","last_peered":"2023-09-28T00:15:58.202984+0000","last_clean":"2023-09-28T00:15:58.202984+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:15:58.202984+0000","last_undegraded":"2023-09-28T00:15:58.202984+0000","last_fullsized":"2023-09-28T00:15:58.202984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:58.202825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:58.202825+0000","last_clean_scrub_stamp":"2023-09-28T00:15:58.202825+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:05:02.833041+0000","scrub_duration":0.0020265230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778247+0000","last_change":"2023-09-28T00:15:29.401695+0000","last_active":"2023-09-28T00:15:30.778247+0000","last_peered":"2023-09-28T00:15:30.778247+0000","last_clean":"2023-09-28T00:15:30.778247+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:15:30.778247+0000","last_undegraded":"2023-09-28T00:15:30.778247+0000","last_fullsized":"2023-09-28T00:15:30.778247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017860+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:15:50.017860+0000","last_peered":"2023-09-28T00:15:50.017860+0000","last_clean":"2023-09-28T00:15:50.017860+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:15:50.017860+0000","last_undegraded":"2023-09-28T00:15:50.017860+0000","last_fullsized":"2023-09-28T00:15:50.017860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:52.314362+0000","last_change":"2023-09-28T00:15:52.314313+0000","last_active":"2023-09-28T00:15:52.314362+0000","last_peered":"2023-09-28T00:15:52.314362+0000","last_clean":"2023-09-28T00:15:52.314362+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:15:52.314362+0000","last_undegraded":"2023-09-28T00:15:52.314362+0000","last_fullsized":"2023-09-28T00:15:52.314362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:52.314217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:52.314217+0000","last_clean_scrub_stamp":"2023-09-28T00:15:52.314217+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:22:43.890895+0000","scrub_duration":0.0018513100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017847+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:15:50.017847+0000","last_peered":"2023-09-28T00:15:50.017847+0000","last_clean":"2023-09-28T00:15:50.017847+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:15:50.017847+0000","last_undegraded":"2023-09-28T00:15:50.017847+0000","last_fullsized":"2023-09-28T00:15:50.017847+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.382304+0000","last_change":"2023-09-28T00:15:29.392231+0000","last_active":"2023-09-28T00:15:30.382304+0000","last_peered":"2023-09-28T00:15:30.382304+0000","last_clean":"2023-09-28T00:15:30.382304+0000","last_became_active":"2023-09-28T00:15:29.391855+0000","last_became_peered":"2023-09-28T00:15:29.391855+0000","last_unstale":"2023-09-28T00:15:30.382304+0000","last_undegraded":"2023-09-28T00:15:30.382304+0000","last_fullsized":"2023-09-28T00:15:30.382304+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:04.657417+0000","last_change":"2023-09-28T00:16:04.657359+0000","last_active":"2023-09-28T00:16:04.657417+0000","last_peered":"2023-09-28T00:16:04.657417+0000","last_clean":"2023-09-28T00:16:04.657417+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:16:04.657417+0000","last_undegraded":"2023-09-28T00:16:04.657417+0000","last_fullsized":"2023-09-28T00:16:04.657417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:04.657222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:04.657222+0000","last_clean_scrub_stamp":"2023-09-28T00:16:04.657222+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:31.711975+0000","scrub_duration":0.0016007720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:04.886952+0000","last_change":"2023-09-28T00:16:04.886920+0000","last_active":"2023-09-28T00:16:04.886952+0000","last_peered":"2023-09-28T00:16:04.886952+0000","last_clean":"2023-09-28T00:16:04.886952+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:16:04.886952+0000","last_undegraded":"2023-09-28T00:16:04.886952+0000","last_fullsized":"2023-09-28T00:16:04.886952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:04.886808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:04.886808+0000","last_clean_scrub_stamp":"2023-09-28T00:16:04.886808+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:04.866638+0000","scrub_duration":0.001535238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.381626+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:15:30.381626+0000","last_peered":"2023-09-28T00:15:30.381626+0000","last_clean":"2023-09-28T00:15:30.381626+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:15:30.381626+0000","last_undegraded":"2023-09-28T00:15:30.381626+0000","last_fullsized":"2023-09-28T00:15:30.381626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777946+0000","last_change":"2023-09-28T00:15:29.392586+0000","last_active":"2023-09-28T00:15:30.777946+0000","last_peered":"2023-09-28T00:15:30.777946+0000","last_clean":"2023-09-28T00:15:30.777946+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:15:30.777946+0000","last_undegraded":"2023-09-28T00:15:30.777946+0000","last_fullsized":"2023-09-28T00:15:30.777946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:03.620884+0000","last_change":"2023-09-28T00:16:03.620852+0000","last_active":"2023-09-28T00:16:03.620884+0000","last_peered":"2023-09-28T00:16:03.620884+0000","last_clean":"2023-09-28T00:16:03.620884+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:16:03.620884+0000","last_undegraded":"2023-09-28T00:16:03.620884+0000","last_fullsized":"2023-09-28T00:16:03.620884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:03.620725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:03.620725+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.620725+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:51.918523+0000","scrub_duration":0.0017002300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.514844+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:15:50.514844+0000","last_peered":"2023-09-28T00:15:50.514844+0000","last_clean":"2023-09-28T00:15:50.514844+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:15:50.514844+0000","last_undegraded":"2023-09-28T00:15:50.514844+0000","last_fullsized":"2023-09-28T00:15:50.514844+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017667+0000","last_change":"2023-09-28T00:15:28.982899+0000","last_active":"2023-09-28T00:15:50.017667+0000","last_peered":"2023-09-28T00:15:50.017667+0000","last_clean":"2023-09-28T00:15:50.017667+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:15:50.017667+0000","last_undegraded":"2023-09-28T00:15:50.017667+0000","last_fullsized":"2023-09-28T00:15:50.017667+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:01.926297+0000","last_change":"2023-09-28T00:16:01.926267+0000","last_active":"2023-09-28T00:16:01.926297+0000","last_peered":"2023-09-28T00:16:01.926297+0000","last_clean":"2023-09-28T00:16:01.926297+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:16:01.926297+0000","last_undegraded":"2023-09-28T00:16:01.926297+0000","last_fullsized":"2023-09-28T00:16:01.926297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:01.926150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:01.926150+0000","last_clean_scrub_stamp":"2023-09-28T00:16:01.926150+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:12:25.987525+0000","scrub_duration":0.0015574779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:55.616905+0000","last_change":"2023-09-28T00:15:55.616876+0000","last_active":"2023-09-28T00:15:55.616905+0000","last_peered":"2023-09-28T00:15:55.616905+0000","last_clean":"2023-09-28T00:15:55.616905+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:15:55.616905+0000","last_undegraded":"2023-09-28T00:15:55.616905+0000","last_fullsized":"2023-09-28T00:15:55.616905+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:55.616759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:55.616759+0000","last_clean_scrub_stamp":"2023-09-28T00:15:55.616759+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:32:29.805704+0000","scrub_duration":0.00169892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778280+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:15:30.778280+0000","last_peered":"2023-09-28T00:15:30.778280+0000","last_clean":"2023-09-28T00:15:30.778280+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:15:30.778280+0000","last_undegraded":"2023-09-28T00:15:30.778280+0000","last_fullsized":"2023-09-28T00:15:30.778280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:56.876658+0000","last_change":"2023-09-28T00:15:56.876590+0000","last_active":"2023-09-28T00:15:56.876658+0000","last_peered":"2023-09-28T00:15:56.876658+0000","last_clean":"2023-09-28T00:15:56.876658+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:15:56.876658+0000","last_undegraded":"2023-09-28T00:15:56.876658+0000","last_fullsized":"2023-09-28T00:15:56.876658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:56.876455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:56.876455+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.876455+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:14.468136+0000","scrub_duration":0.0015522699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:05.256930+0000","last_change":"2023-09-28T00:16:05.256890+0000","last_active":"2023-09-28T00:16:05.256930+0000","last_peered":"2023-09-28T00:16:05.256930+0000","last_clean":"2023-09-28T00:16:05.256930+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:16:05.256930+0000","last_undegraded":"2023-09-28T00:16:05.256930+0000","last_fullsized":"2023-09-28T00:16:05.256930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.256766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.256766+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.256766+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:54.999721+0000","scrub_duration":0.0015163100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:59.709514+0000","last_change":"2023-09-28T00:15:59.709473+0000","last_active":"2023-09-28T00:15:59.709514+0000","last_peered":"2023-09-28T00:15:59.709514+0000","last_clean":"2023-09-28T00:15:59.709514+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:15:59.709514+0000","last_undegraded":"2023-09-28T00:15:59.709514+0000","last_fullsized":"2023-09-28T00:15:59.709514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:59.709361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:59.709361+0000","last_clean_scrub_stamp":"2023-09-28T00:15:59.709361+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:48.007160+0000","scrub_duration":0.0020169540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:05.850293+0000","last_change":"2023-09-28T00:16:05.850253+0000","last_active":"2023-09-28T00:16:05.850293+0000","last_peered":"2023-09-28T00:16:05.850293+0000","last_clean":"2023-09-28T00:16:05.850293+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:16:05.850293+0000","last_undegraded":"2023-09-28T00:16:05.850293+0000","last_fullsized":"2023-09-28T00:16:05.850293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.850133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.850133+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.850133+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:32.904885+0000","scrub_duration":0.00147853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:09.443229+0000","last_change":"2023-09-28T00:16:09.443171+0000","last_active":"2023-09-28T00:16:09.443229+0000","last_peered":"2023-09-28T00:16:09.443229+0000","last_clean":"2023-09-28T00:16:09.443229+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:16:09.443229+0000","last_undegraded":"2023-09-28T00:16:09.443229+0000","last_fullsized":"2023-09-28T00:16:09.443229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:09.443032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:09.443032+0000","last_clean_scrub_stamp":"2023-09-28T00:16:09.443032+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:36.497785+0000","scrub_duration":0.00158618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777333+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:15:30.777333+0000","last_peered":"2023-09-28T00:15:30.777333+0000","last_clean":"2023-09-28T00:15:30.777333+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:15:30.777333+0000","last_undegraded":"2023-09-28T00:15:30.777333+0000","last_fullsized":"2023-09-28T00:15:30.777333+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.382157+0000","last_change":"2023-09-28T00:15:28.981865+0000","last_active":"2023-09-28T00:15:30.382157+0000","last_peered":"2023-09-28T00:15:30.382157+0000","last_clean":"2023-09-28T00:15:30.382157+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:15:30.382157+0000","last_undegraded":"2023-09-28T00:15:30.382157+0000","last_fullsized":"2023-09-28T00:15:30.382157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777177+0000","last_change":"2023-09-28T00:15:29.389604+0000","last_active":"2023-09-28T00:15:30.777177+0000","last_peered":"2023-09-28T00:15:30.777177+0000","last_clean":"2023-09-28T00:15:30.777177+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:15:30.777177+0000","last_undegraded":"2023-09-28T00:15:30.777177+0000","last_fullsized":"2023-09-28T00:15:30.777177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017650+0000","last_change":"2023-09-28T00:15:28.979093+0000","last_active":"2023-09-28T00:15:50.017650+0000","last_peered":"2023-09-28T00:15:50.017650+0000","last_clean":"2023-09-28T00:15:50.017650+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:15:50.017650+0000","last_undegraded":"2023-09-28T00:15:50.017650+0000","last_fullsized":"2023-09-28T00:15:50.017650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017759+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:15:50.017759+0000","last_peered":"2023-09-28T00:15:50.017759+0000","last_clean":"2023-09-28T00:15:50.017759+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:15:50.017759+0000","last_undegraded":"2023-09-28T00:15:50.017759+0000","last_fullsized":"2023-09-28T00:15:50.017759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.382199+0000","last_change":"2023-09-28T00:15:28.985348+0000","last_active":"2023-09-28T00:15:30.382199+0000","last_peered":"2023-09-28T00:15:30.382199+0000","last_clean":"2023-09-28T00:15:30.382199+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:15:30.382199+0000","last_undegraded":"2023-09-28T00:15:30.382199+0000","last_fullsized":"2023-09-28T00:15:30.382199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778275+0000","last_change":"2023-09-28T00:15:29.383322+0000","last_active":"2023-09-28T00:15:30.778275+0000","last_peered":"2023-09-28T00:15:30.778275+0000","last_clean":"2023-09-28T00:15:30.778275+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:15:30.778275+0000","last_undegraded":"2023-09-28T00:15:30.778275+0000","last_fullsized":"2023-09-28T00:15:30.778275+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:48.623017+0000","last_change":"2023-09-28T00:15:48.622966+0000","last_active":"2023-09-28T00:15:48.623017+0000","last_peered":"2023-09-28T00:15:48.623017+0000","last_clean":"2023-09-28T00:15:48.623017+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:15:48.623017+0000","last_undegraded":"2023-09-28T00:15:48.623017+0000","last_fullsized":"2023-09-28T00:15:48.623017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:48.622809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:48.622809+0000","last_clean_scrub_stamp":"2023-09-28T00:15:48.622809+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:04:59.170139+0000","scrub_duration":0.0017786600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.514767+0000","last_change":"2023-09-28T00:15:29.395546+0000","last_active":"2023-09-28T00:15:50.514767+0000","last_peered":"2023-09-28T00:15:50.514767+0000","last_clean":"2023-09-28T00:15:50.514767+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:15:50.514767+0000","last_undegraded":"2023-09-28T00:15:50.514767+0000","last_fullsized":"2023-09-28T00:15:50.514767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.381902+0000","last_change":"2023-09-28T00:15:28.985438+0000","last_active":"2023-09-28T00:15:30.381902+0000","last_peered":"2023-09-28T00:15:30.381902+0000","last_clean":"2023-09-28T00:15:30.381902+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:15:30.381902+0000","last_undegraded":"2023-09-28T00:15:30.381902+0000","last_fullsized":"2023-09-28T00:15:30.381902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778212+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:15:30.778212+0000","last_peered":"2023-09-28T00:15:30.778212+0000","last_clean":"2023-09-28T00:15:30.778212+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:15:30.778212+0000","last_undegraded":"2023-09-28T00:15:30.778212+0000","last_fullsized":"2023-09-28T00:15:30.778212+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:56.333009+0000","last_change":"2023-09-28T00:15:56.332960+0000","last_active":"2023-09-28T00:15:56.333009+0000","last_peered":"2023-09-28T00:15:56.333009+0000","last_clean":"2023-09-28T00:15:56.333009+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:15:56.333009+0000","last_undegraded":"2023-09-28T00:15:56.333009+0000","last_fullsized":"2023-09-28T00:15:56.333009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2023-09-28T00:15:56.332853+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2023-09-28T00:15:56.332853+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.332853+0000","objects_scrubbed":4,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:45.230235+0000","scrub_duration":0.0027676580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777894+0000","last_change":"2023-09-28T00:15:29.393952+0000","last_active":"2023-09-28T00:15:30.777894+0000","last_peered":"2023-09-28T00:15:30.777894+0000","last_clean":"2023-09-28T00:15:30.777894+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:15:30.777894+0000","last_undegraded":"2023-09-28T00:15:30.777894+0000","last_fullsized":"2023-09-28T00:15:30.777894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.382019+0000","last_change":"2023-09-28T00:15:28.986391+0000","last_active":"2023-09-28T00:15:30.382019+0000","last_peered":"2023-09-28T00:15:30.382019+0000","last_clean":"2023-09-28T00:15:30.382019+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:15:30.382019+0000","last_undegraded":"2023-09-28T00:15:30.382019+0000","last_fullsized":"2023-09-28T00:15:30.382019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.514681+0000","last_change":"2023-09-28T00:15:29.393474+0000","last_active":"2023-09-28T00:15:50.514681+0000","last_peered":"2023-09-28T00:15:50.514681+0000","last_clean":"2023-09-28T00:15:50.514681+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:15:50.514681+0000","last_undegraded":"2023-09-28T00:15:50.514681+0000","last_fullsized":"2023-09-28T00:15:50.514681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.381621+0000","last_change":"2023-09-28T00:15:28.986082+0000","last_active":"2023-09-28T00:15:30.381621+0000","last_peered":"2023-09-28T00:15:30.381621+0000","last_clean":"2023-09-28T00:15:30.381621+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:15:30.381621+0000","last_undegraded":"2023-09-28T00:15:30.381621+0000","last_fullsized":"2023-09-28T00:15:30.381621+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017755+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:15:50.017755+0000","last_peered":"2023-09-28T00:15:50.017755+0000","last_clean":"2023-09-28T00:15:50.017755+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:15:50.017755+0000","last_undegraded":"2023-09-28T00:15:50.017755+0000","last_fullsized":"2023-09-28T00:15:50.017755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.382290+0000","last_change":"2023-09-28T00:15:28.982433+0000","last_active":"2023-09-28T00:15:30.382290+0000","last_peered":"2023-09-28T00:15:30.382290+0000","last_clean":"2023-09-28T00:15:30.382290+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:15:30.382290+0000","last_undegraded":"2023-09-28T00:15:30.382290+0000","last_fullsized":"2023-09-28T00:15:30.382290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:51.010187+0000","last_change":"2023-09-28T00:15:29.388766+0000","last_active":"2023-09-28T00:15:51.010187+0000","last_peered":"2023-09-28T00:15:51.010187+0000","last_clean":"2023-09-28T00:15:51.010187+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:15:51.010187+0000","last_undegraded":"2023-09-28T00:15:51.010187+0000","last_fullsized":"2023-09-28T00:15:51.010187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:08.420434+0000","last_change":"2023-09-28T00:16:08.420377+0000","last_active":"2023-09-28T00:16:08.420434+0000","last_peered":"2023-09-28T00:16:08.420434+0000","last_clean":"2023-09-28T00:16:08.420434+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:16:08.420434+0000","last_undegraded":"2023-09-28T00:16:08.420434+0000","last_fullsized":"2023-09-28T00:16:08.420434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:08.420273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:08.420273+0000","last_clean_scrub_stamp":"2023-09-28T00:16:08.420273+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:08.400103+0000","scrub_duration":0.001767086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.779168+0000","last_change":"2023-09-28T00:15:29.386850+0000","last_active":"2023-09-28T00:15:30.779168+0000","last_peered":"2023-09-28T00:15:30.779168+0000","last_clean":"2023-09-28T00:15:30.779168+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:15:30.779168+0000","last_undegraded":"2023-09-28T00:15:30.779168+0000","last_fullsized":"2023-09-28T00:15:30.779168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:53.885246+0000","last_change":"2023-09-28T00:15:53.885189+0000","last_active":"2023-09-28T00:15:53.885246+0000","last_peered":"2023-09-28T00:15:53.885246+0000","last_clean":"2023-09-28T00:15:53.885246+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:15:53.885246+0000","last_undegraded":"2023-09-28T00:15:53.885246+0000","last_fullsized":"2023-09-28T00:15:53.885246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-28T00:15:53.885072+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-28T00:15:53.885072+0000","last_clean_scrub_stamp":"2023-09-28T00:15:53.885072+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:43.628028+0000","scrub_duration":0.0020480469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:53.159256+0000","last_change":"2023-09-28T00:15:53.159199+0000","last_active":"2023-09-28T00:15:53.159256+0000","last_peered":"2023-09-28T00:15:53.159256+0000","last_clean":"2023-09-28T00:15:53.159256+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:15:53.159256+0000","last_undegraded":"2023-09-28T00:15:53.159256+0000","last_fullsized":"2023-09-28T00:15:53.159256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:53.159094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:53.159094+0000","last_clean_scrub_stamp":"2023-09-28T00:15:53.159094+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:10.750775+0000","scrub_duration":0.0021930320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:03.295842+0000","last_change":"2023-09-28T00:16:03.295793+0000","last_active":"2023-09-28T00:16:03.295842+0000","last_peered":"2023-09-28T00:16:03.295842+0000","last_clean":"2023-09-28T00:16:03.295842+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:16:03.295842+0000","last_undegraded":"2023-09-28T00:16:03.295842+0000","last_fullsized":"2023-09-28T00:16:03.295842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:03.295686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:03.295686+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.295686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:32:37.484631+0000","scrub_duration":0.0016463370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017713+0000","last_change":"2023-09-28T00:15:29.400083+0000","last_active":"2023-09-28T00:15:50.017713+0000","last_peered":"2023-09-28T00:15:50.017713+0000","last_clean":"2023-09-28T00:15:50.017713+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:15:50.017713+0000","last_undegraded":"2023-09-28T00:15:50.017713+0000","last_fullsized":"2023-09-28T00:15:50.017713+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:01.173344+0000","last_change":"2023-09-28T00:16:01.173298+0000","last_active":"2023-09-28T00:16:01.173344+0000","last_peered":"2023-09-28T00:16:01.173344+0000","last_clean":"2023-09-28T00:16:01.173344+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:16:01.173344+0000","last_undegraded":"2023-09-28T00:16:01.173344+0000","last_fullsized":"2023-09-28T00:16:01.173344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:01.173171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:01.173171+0000","last_clean_scrub_stamp":"2023-09-28T00:16:01.173171+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:28.227924+0000","scrub_duration":0.0020952499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:00.181210+0000","last_change":"2023-09-28T00:16:00.181152+0000","last_active":"2023-09-28T00:16:00.181210+0000","last_peered":"2023-09-28T00:16:00.181210+0000","last_clean":"2023-09-28T00:16:00.181210+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:16:00.181210+0000","last_undegraded":"2023-09-28T00:16:00.181210+0000","last_fullsized":"2023-09-28T00:16:00.181210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:00.181000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:00.181000+0000","last_clean_scrub_stamp":"2023-09-28T00:16:00.181000+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:00.160829+0000","scrub_duration":0.0017584429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:49.877546+0000","last_change":"2023-09-28T00:15:49.877522+0000","last_active":"2023-09-28T00:15:49.877546+0000","last_peered":"2023-09-28T00:15:49.877546+0000","last_clean":"2023-09-28T00:15:49.877546+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:15:49.877546+0000","last_undegraded":"2023-09-28T00:15:49.877546+0000","last_fullsized":"2023-09-28T00:15:49.877546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:49.877418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:49.877418+0000","last_clean_scrub_stamp":"2023-09-28T00:15:49.877418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:05:00.424748+0000","scrub_duration":0.0014756789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":25,"state":"peering","last_fresh":"2023-09-28T00:16:10.022107+0000","last_change":"2023-09-28T00:16:10.022107+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-28T00:16:10.022107+0000","last_undegraded":"2023-09-28T00:16:10.022107+0000","last_fullsized":"2023-09-28T00:16:10.022107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:08.509135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:08.509135+0000","last_clean_scrub_stamp":"2023-09-28T00:16:08.509135+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:21:42.628600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:48.686415+0000","last_change":"2023-09-28T00:15:48.686393+0000","last_active":"2023-09-28T00:15:48.686415+0000","last_peered":"2023-09-28T00:15:48.686415+0000","last_clean":"2023-09-28T00:15:48.686415+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:15:48.686415+0000","last_undegraded":"2023-09-28T00:15:48.686415+0000","last_fullsized":"2023-09-28T00:15:48.686415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:48.686304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:48.686304+0000","last_clean_scrub_stamp":"2023-09-28T00:15:48.686304+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:37.583686+0000","scrub_duration":0.0013027640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.514759+0000","last_change":"2023-09-28T00:15:28.986194+0000","last_active":"2023-09-28T00:15:50.514759+0000","last_peered":"2023-09-28T00:15:50.514759+0000","last_clean":"2023-09-28T00:15:50.514759+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:15:50.514759+0000","last_undegraded":"2023-09-28T00:15:50.514759+0000","last_fullsized":"2023-09-28T00:15:50.514759+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:05.593547+0000","last_change":"2023-09-28T00:16:05.593506+0000","last_active":"2023-09-28T00:16:05.593547+0000","last_peered":"2023-09-28T00:16:05.593547+0000","last_clean":"2023-09-28T00:16:05.593547+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:16:05.593547+0000","last_undegraded":"2023-09-28T00:16:05.593547+0000","last_fullsized":"2023-09-28T00:16:05.593547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.593397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.593397+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.593397+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:05:10.223613+0000","scrub_duration":0.0020412870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:00.499047+0000","last_change":"2023-09-28T00:16:00.498971+0000","last_active":"2023-09-28T00:16:00.499047+0000","last_peered":"2023-09-28T00:16:00.499047+0000","last_clean":"2023-09-28T00:16:00.499047+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:16:00.499047+0000","last_undegraded":"2023-09-28T00:16:00.499047+0000","last_fullsized":"2023-09-28T00:16:00.499047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:00.498859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:00.498859+0000","last_clean_scrub_stamp":"2023-09-28T00:16:00.498859+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:18.090540+0000","scrub_duration":0.0020023010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:05.136976+0000","last_change":"2023-09-28T00:16:05.136936+0000","last_active":"2023-09-28T00:16:05.136976+0000","last_peered":"2023-09-28T00:16:05.136976+0000","last_clean":"2023-09-28T00:16:05.136976+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:16:05.136976+0000","last_undegraded":"2023-09-28T00:16:05.136976+0000","last_fullsized":"2023-09-28T00:16:05.136976+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.136820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.136820+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.136820+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:36:09.154862+0000","scrub_duration":0.00184125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:07.548138+0000","last_change":"2023-09-28T00:16:07.548108+0000","last_active":"2023-09-28T00:16:07.548138+0000","last_peered":"2023-09-28T00:16:07.548138+0000","last_clean":"2023-09-28T00:16:07.548138+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:16:07.548138+0000","last_undegraded":"2023-09-28T00:16:07.548138+0000","last_fullsized":"2023-09-28T00:16:07.548138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:07.548002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:07.548002+0000","last_clean_scrub_stamp":"2023-09-28T00:16:07.548002+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:07.527832+0000","scrub_duration":0.001605205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:49.304738+0000","last_change":"2023-09-28T00:15:49.304707+0000","last_active":"2023-09-28T00:15:49.304738+0000","last_peered":"2023-09-28T00:15:49.304738+0000","last_clean":"2023-09-28T00:15:49.304738+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:15:49.304738+0000","last_undegraded":"2023-09-28T00:15:49.304738+0000","last_fullsized":"2023-09-28T00:15:49.304738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:49.304605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:49.304605+0000","last_clean_scrub_stamp":"2023-09-28T00:15:49.304605+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:31.322663+0000","scrub_duration":0.0012867289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:00.590344+0000","last_change":"2023-09-28T00:16:00.590315+0000","last_active":"2023-09-28T00:16:00.590344+0000","last_peered":"2023-09-28T00:16:00.590344+0000","last_clean":"2023-09-28T00:16:00.590344+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:16:00.590344+0000","last_undegraded":"2023-09-28T00:16:00.590344+0000","last_fullsized":"2023-09-28T00:16:00.590344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:00.590197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:00.590197+0000","last_clean_scrub_stamp":"2023-09-28T00:16:00.590197+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:18.181878+0000","scrub_duration":0.0017790499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778062+0000","last_change":"2023-09-28T00:15:29.388008+0000","last_active":"2023-09-28T00:15:30.778062+0000","last_peered":"2023-09-28T00:15:30.778062+0000","last_clean":"2023-09-28T00:15:30.778062+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:15:30.778062+0000","last_undegraded":"2023-09-28T00:15:30.778062+0000","last_fullsized":"2023-09-28T00:15:30.778062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:55.506397+0000","last_change":"2023-09-28T00:15:55.506327+0000","last_active":"2023-09-28T00:15:55.506397+0000","last_peered":"2023-09-28T00:15:55.506397+0000","last_clean":"2023-09-28T00:15:55.506397+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:15:55.506397+0000","last_undegraded":"2023-09-28T00:15:55.506397+0000","last_fullsized":"2023-09-28T00:15:55.506397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:55.506216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:55.506216+0000","last_clean_scrub_stamp":"2023-09-28T00:15:55.506216+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:34.313252+0000","scrub_duration":0.0022483070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":179,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:58.809165+0000","last_change":"2023-09-28T00:15:58.809117+0000","last_active":"2023-09-28T00:15:58.809165+0000","last_peered":"2023-09-28T00:15:58.809165+0000","last_clean":"2023-09-28T00:15:58.809165+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:15:58.809165+0000","last_undegraded":"2023-09-28T00:15:58.809165+0000","last_fullsized":"2023-09-28T00:15:58.809165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2023-09-28T00:15:58.809014+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2023-09-28T00:15:58.809014+0000","last_clean_scrub_stamp":"2023-09-28T00:15:58.809014+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:37.616051+0000","scrub_duration":0.0056860469999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:51.870238+0000","last_change":"2023-09-28T00:15:51.870215+0000","last_active":"2023-09-28T00:15:51.870238+0000","last_peered":"2023-09-28T00:15:51.870238+0000","last_clean":"2023-09-28T00:15:51.870238+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:15:51.870238+0000","last_undegraded":"2023-09-28T00:15:51.870238+0000","last_fullsized":"2023-09-28T00:15:51.870238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:51.870131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:51.870131+0000","last_clean_scrub_stamp":"2023-09-28T00:15:51.870131+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:32:26.059076+0000","scrub_duration":0.0018609810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:51.010183+0000","last_change":"2023-09-28T00:15:29.401863+0000","last_active":"2023-09-28T00:15:51.010183+0000","last_peered":"2023-09-28T00:15:51.010183+0000","last_clean":"2023-09-28T00:15:51.010183+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:15:51.010183+0000","last_undegraded":"2023-09-28T00:15:51.010183+0000","last_fullsized":"2023-09-28T00:15:51.010183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:03.753226+0000","last_change":"2023-09-28T00:16:03.753189+0000","last_active":"2023-09-28T00:16:03.753226+0000","last_peered":"2023-09-28T00:16:03.753226+0000","last_clean":"2023-09-28T00:16:03.753226+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:16:03.753226+0000","last_undegraded":"2023-09-28T00:16:03.753226+0000","last_fullsized":"2023-09-28T00:16:03.753226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:03.753087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:03.753087+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.753087+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:21.344768+0000","scrub_duration":0.0022902560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:01.732317+0000","last_change":"2023-09-28T00:16:01.732279+0000","last_active":"2023-09-28T00:16:01.732317+0000","last_peered":"2023-09-28T00:16:01.732317+0000","last_clean":"2023-09-28T00:16:01.732317+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:16:01.732317+0000","last_undegraded":"2023-09-28T00:16:01.732317+0000","last_fullsized":"2023-09-28T00:16:01.732317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:01.732160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:01.732160+0000","last_clean_scrub_stamp":"2023-09-28T00:16:01.732160+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:05:06.362375+0000","scrub_duration":0.0018186770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.778391+0000","last_change":"2023-09-28T00:15:29.390313+0000","last_active":"2023-09-28T00:15:30.778391+0000","last_peered":"2023-09-28T00:15:30.778391+0000","last_clean":"2023-09-28T00:15:30.778391+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:15:30.778391+0000","last_undegraded":"2023-09-28T00:15:30.778391+0000","last_fullsized":"2023-09-28T00:15:30.778391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:06.787771+0000","last_change":"2023-09-28T00:16:06.787743+0000","last_active":"2023-09-28T00:16:06.787771+0000","last_peered":"2023-09-28T00:16:06.787771+0000","last_clean":"2023-09-28T00:16:06.787771+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:16:06.787771+0000","last_undegraded":"2023-09-28T00:16:06.787771+0000","last_fullsized":"2023-09-28T00:16:06.787771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:06.787615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:06.787615+0000","last_clean_scrub_stamp":"2023-09-28T00:16:06.787615+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:55.085413+0000","scrub_duration":0.002110392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:57.594860+0000","last_change":"2023-09-28T00:15:57.594832+0000","last_active":"2023-09-28T00:15:57.594860+0000","last_peered":"2023-09-28T00:15:57.594860+0000","last_clean":"2023-09-28T00:15:57.594860+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:15:57.594860+0000","last_undegraded":"2023-09-28T00:15:57.594860+0000","last_fullsized":"2023-09-28T00:15:57.594860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:57.594711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:57.594711+0000","last_clean_scrub_stamp":"2023-09-28T00:15:57.594711+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:47.337667+0000","scrub_duration":0.001619428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.779031+0000","last_change":"2023-09-28T00:15:29.398984+0000","last_active":"2023-09-28T00:15:30.779031+0000","last_peered":"2023-09-28T00:15:30.779031+0000","last_clean":"2023-09-28T00:15:30.779031+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:15:30.779031+0000","last_undegraded":"2023-09-28T00:15:30.779031+0000","last_fullsized":"2023-09-28T00:15:30.779031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:52.853865+0000","last_change":"2023-09-28T00:15:52.853832+0000","last_active":"2023-09-28T00:15:52.853865+0000","last_peered":"2023-09-28T00:15:52.853865+0000","last_clean":"2023-09-28T00:15:52.853865+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:15:52.853865+0000","last_undegraded":"2023-09-28T00:15:52.853865+0000","last_fullsized":"2023-09-28T00:15:52.853865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-28T00:15:52.853723+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-28T00:15:52.853723+0000","last_clean_scrub_stamp":"2023-09-28T00:15:52.853723+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:31.660759+0000","scrub_duration":0.0022132520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:52.639955+0000","last_change":"2023-09-28T00:15:52.639926+0000","last_active":"2023-09-28T00:15:52.639955+0000","last_peered":"2023-09-28T00:15:52.639955+0000","last_clean":"2023-09-28T00:15:52.639955+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:15:52.639955+0000","last_undegraded":"2023-09-28T00:15:52.639955+0000","last_fullsized":"2023-09-28T00:15:52.639955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:52.639814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:52.639814+0000","last_clean_scrub_stamp":"2023-09-28T00:15:52.639814+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:05:03.187143+0000","scrub_duration":0.0017377740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777492+0000","last_change":"2023-09-28T00:15:29.386508+0000","last_active":"2023-09-28T00:15:30.777492+0000","last_peered":"2023-09-28T00:15:30.777492+0000","last_clean":"2023-09-28T00:15:30.777492+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:15:30.777492+0000","last_undegraded":"2023-09-28T00:15:30.777492+0000","last_fullsized":"2023-09-28T00:15:30.777492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:54.304479+0000","last_change":"2023-09-28T00:15:54.304435+0000","last_active":"2023-09-28T00:15:54.304479+0000","last_peered":"2023-09-28T00:15:54.304479+0000","last_clean":"2023-09-28T00:15:54.304479+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:15:54.304479+0000","last_undegraded":"2023-09-28T00:15:54.304479+0000","last_fullsized":"2023-09-28T00:15:54.304479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:54.304310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:54.304310+0000","last_clean_scrub_stamp":"2023-09-28T00:15:54.304310+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:49:16.397435+0000","scrub_duration":0.0015026149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:53.627543+0000","last_change":"2023-09-28T00:15:53.627491+0000","last_active":"2023-09-28T00:15:53.627543+0000","last_peered":"2023-09-28T00:15:53.627543+0000","last_clean":"2023-09-28T00:15:53.627543+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:15:53.627543+0000","last_undegraded":"2023-09-28T00:15:53.627543+0000","last_fullsized":"2023-09-28T00:15:53.627543+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2023-09-28T00:15:53.627380+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2023-09-28T00:15:53.627380+0000","last_clean_scrub_stamp":"2023-09-28T00:15:53.627380+0000","objects_scrubbed":1,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:43.370335+0000","scrub_duration":0.0019854999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:56.189031+0000","last_change":"2023-09-28T00:15:56.188990+0000","last_active":"2023-09-28T00:15:56.189031+0000","last_peered":"2023-09-28T00:15:56.189031+0000","last_clean":"2023-09-28T00:15:56.189031+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:15:56.189031+0000","last_undegraded":"2023-09-28T00:15:56.189031+0000","last_fullsized":"2023-09-28T00:15:56.189031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:56.188876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:56.188876+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.188876+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:44.486675+0000","scrub_duration":0.0016262119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:56.746044+0000","last_change":"2023-09-28T00:15:56.746011+0000","last_active":"2023-09-28T00:15:56.746044+0000","last_peered":"2023-09-28T00:15:56.746044+0000","last_clean":"2023-09-28T00:15:56.746044+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:15:56.746044+0000","last_undegraded":"2023-09-28T00:15:56.746044+0000","last_fullsized":"2023-09-28T00:15:56.746044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-09-28T00:15:56.745896+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-09-28T00:15:56.745896+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.745896+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:14.337578+0000","scrub_duration":0.00152447,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.315247+0000","last_change":"2023-09-28T00:15:50.315214+0000","last_active":"2023-09-28T00:15:50.315247+0000","last_peered":"2023-09-28T00:15:50.315247+0000","last_clean":"2023-09-28T00:15:50.315247+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:15:50.315247+0000","last_undegraded":"2023-09-28T00:15:50.315247+0000","last_fullsized":"2023-09-28T00:15:50.315247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:50.315106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:50.315106+0000","last_clean_scrub_stamp":"2023-09-28T00:15:50.315106+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:05:47.010373+0000","scrub_duration":0.0014511070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.514660+0000","last_change":"2023-09-28T00:15:28.987633+0000","last_active":"2023-09-28T00:15:50.514660+0000","last_peered":"2023-09-28T00:15:50.514660+0000","last_clean":"2023-09-28T00:15:50.514660+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:15:50.514660+0000","last_undegraded":"2023-09-28T00:15:50.514660+0000","last_fullsized":"2023-09-28T00:15:50.514660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:27.949819+0000","last_clean_scrub_stamp":"2023-09-28T00:15:27.949819+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017823+0000","last_change":"2023-09-28T00:15:29.392897+0000","last_active":"2023-09-28T00:15:50.017823+0000","last_peered":"2023-09-28T00:15:50.017823+0000","last_clean":"2023-09-28T00:15:50.017823+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:15:50.017823+0000","last_undegraded":"2023-09-28T00:15:50.017823+0000","last_fullsized":"2023-09-28T00:15:50.017823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:03.483602+0000","last_change":"2023-09-28T00:16:03.483521+0000","last_active":"2023-09-28T00:16:03.483602+0000","last_peered":"2023-09-28T00:16:03.483602+0000","last_clean":"2023-09-28T00:16:03.483602+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:16:03.483602+0000","last_undegraded":"2023-09-28T00:16:03.483602+0000","last_fullsized":"2023-09-28T00:16:03.483602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2023-09-28T00:16:03.483392+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2023-09-28T00:16:03.483392+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.483392+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:51.781190+0000","scrub_duration":0.0026205619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017763+0000","last_change":"2023-09-28T00:15:29.394598+0000","last_active":"2023-09-28T00:15:50.017763+0000","last_peered":"2023-09-28T00:15:50.017763+0000","last_clean":"2023-09-28T00:15:50.017763+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:15:50.017763+0000","last_undegraded":"2023-09-28T00:15:50.017763+0000","last_fullsized":"2023-09-28T00:15:50.017763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:59.949731+0000","last_change":"2023-09-28T00:15:59.949690+0000","last_active":"2023-09-28T00:15:59.949731+0000","last_peered":"2023-09-28T00:15:59.949731+0000","last_clean":"2023-09-28T00:15:59.949731+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:15:59.949731+0000","last_undegraded":"2023-09-28T00:15:59.949731+0000","last_fullsized":"2023-09-28T00:15:59.949731+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-09-28T00:15:59.949496+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-09-28T00:15:59.949496+0000","last_clean_scrub_stamp":"2023-09-28T00:15:59.949496+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:48.247295+0000","scrub_duration":0.0018437670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777317+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:15:30.777317+0000","last_peered":"2023-09-28T00:15:30.777317+0000","last_clean":"2023-09-28T00:15:30.777317+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:15:30.777317+0000","last_undegraded":"2023-09-28T00:15:30.777317+0000","last_fullsized":"2023-09-28T00:15:30.777317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'6","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:03.661924+0000","last_change":"2023-09-28T00:16:03.661895+0000","last_active":"2023-09-28T00:16:03.661924+0000","last_peered":"2023-09-28T00:16:03.661924+0000","last_clean":"2023-09-28T00:16:03.661924+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:16:03.661924+0000","last_undegraded":"2023-09-28T00:16:03.661924+0000","last_fullsized":"2023-09-28T00:16:03.661924+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2023-09-28T00:16:03.661795+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2023-09-28T00:16:03.661795+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.661795+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:03.641625+0000","scrub_duration":0.0039856939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017778+0000","last_change":"2023-09-28T00:15:29.398360+0000","last_active":"2023-09-28T00:15:50.017778+0000","last_peered":"2023-09-28T00:15:50.017778+0000","last_clean":"2023-09-28T00:15:50.017778+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:15:50.017778+0000","last_undegraded":"2023-09-28T00:15:50.017778+0000","last_fullsized":"2023-09-28T00:15:50.017778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:16:08.212514+0000","last_change":"2023-09-28T00:16:08.212474+0000","last_active":"2023-09-28T00:16:08.212514+0000","last_peered":"2023-09-28T00:16:08.212514+0000","last_clean":"2023-09-28T00:16:08.212514+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:16:08.212514+0000","last_undegraded":"2023-09-28T00:16:08.212514+0000","last_fullsized":"2023-09-28T00:16:08.212514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:08.212359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:08.212359+0000","last_clean_scrub_stamp":"2023-09-28T00:16:08.212359+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:25.804040+0000","scrub_duration":0.0019597149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777241+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:15:30.777241+0000","last_peered":"2023-09-28T00:15:30.777241+0000","last_clean":"2023-09-28T00:15:30.777241+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:15:30.777241+0000","last_undegraded":"2023-09-28T00:15:30.777241+0000","last_fullsized":"2023-09-28T00:15:30.777241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:50.017876+0000","last_change":"2023-09-28T00:15:29.399203+0000","last_active":"2023-09-28T00:15:50.017876+0000","last_peered":"2023-09-28T00:15:50.017876+0000","last_clean":"2023-09-28T00:15:50.017876+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:15:50.017876+0000","last_undegraded":"2023-09-28T00:15:50.017876+0000","last_fullsized":"2023-09-28T00:15:50.017876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777725+0000","last_change":"2023-09-28T00:15:29.388644+0000","last_active":"2023-09-28T00:15:30.777725+0000","last_peered":"2023-09-28T00:15:30.777725+0000","last_clean":"2023-09-28T00:15:30.777725+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:15:30.777725+0000","last_undegraded":"2023-09-28T00:15:30.777725+0000","last_fullsized":"2023-09-28T00:15:30.777725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-09-28T00:15:30.777452+0000","last_change":"2023-09-28T00:15:29.388432+0000","last_active":"2023-09-28T00:15:30.777452+0000","last_peered":"2023-09-28T00:15:30.777452+0000","last_clean":"2023-09-28T00:15:30.777452+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:15:30.777452+0000","last_undegraded":"2023-09-28T00:15:30.777452+0000","last_fullsized":"2023-09-28T00:15:30.777452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542159,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8080,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363760,"statfs":{"total":96636764160,"available":96628490240,"internally_reserved":0,"allocated":270336,"data_stored":100128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8060,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363780,"statfs":{"total":96636764160,"available":96628510720,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9156,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362684,"statfs":{"total":96636764160,"available":96627388416,"internally_reserved":0,"allocated":847872,"data_stored":684060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9180,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362660,"statfs":{"total":96636764160,"available":96627363840,"internally_reserved":0,"allocated":872448,"data_stored":685258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":93138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8064,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363776,"statfs":{"total":96636764160,"available":96628506624,"internally_reserved":0,"allocated":253952,"data_stored":93228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8092,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363748,"statfs":{"total":96636764160,"available":96628477952,"internally_reserved":0,"allocated":282624,"data_stored":101096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:16:12.255 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.255 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.256 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.256 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.256 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.256 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.256 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.256 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.257 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.257 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.257 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.257 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.257 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.258 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.258 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.258 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.258 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.258 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.258 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.259 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.259 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.259 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.259 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.259 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.260 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.260 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.260 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.260 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.260 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.260 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.261 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.261 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.261 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.261 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.261 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.262 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.262 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.262 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.262 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.262 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.263 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.263 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.263 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.263 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.263 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.264 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.264 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-28T00:15:27.949819+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=27, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.264 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.264 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.264 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.265 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.265 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.265 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.265 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.265 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:12.266 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T00:16:30.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:16:30.337 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:16:32.267 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:16:32.399 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.398+0000 7fb9069ca700 1 Processor -- start 2023-09-28T00:16:32.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.398+0000 7fb9069ca700 1 -- start start 2023-09-28T00:16:32.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.399+0000 7fb9069ca700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000cdc00 0x7fb9000cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:32.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.399+0000 7fb9069ca700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9000ae140 con 0x7fb9000c6dc0 2023-09-28T00:16:32.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.399+0000 7fb9069ca700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9000ad530 con 0x7fb9000d1030 2023-09-28T00:16:32.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.399+0000 7fb9069ca700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000cc390 con 0x7fb9000cdc00 2023-09-28T00:16:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.399+0000 7fb904f67700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb9000c6dc0 0x7fb9000ae5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53638/0 (socket says 172.21.15.26:53638) 2023-09-28T00:16:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.399+0000 7fb904f67700 1 -- 172.21.15.26:0/1852155522 learned_addr learned my addr 172.21.15.26:0/1852155522 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:16:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8fffff700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000cdc00 0x7fb9000cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565648683 0 0) 0x7fb9000ae140 con 0x7fb9000c6dc0 2023-09-28T00:16:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8ec003570 con 0x7fb9000c6dc0 2023-09-28T00:16:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2662837740 0 0) 0x7fb9000ad530 con 0x7fb9000d1030 2023-09-28T00:16:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9000ae140 con 0x7fb9000d1030 2023-09-28T00:16:32.404 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2188867610 0 0) 0x7fb8ec003570 con 0x7fb9000c6dc0 2023-09-28T00:16:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000cdc00 msgr2=0x7fb9000cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000cdc00 0x7fb9000cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 >> v1:172.21.15.190:6789/0 conn(0x7fb9000d1030 legacy=0x7fb9000c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9000ad810 con 0x7fb9000c6dc0 2023-09-28T00:16:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fb8f80017f0 con 0x7fb9000c6dc0 2023-09-28T00:16:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 >> v1:172.21.15.26:6789/0 conn(0x7fb9000c6dc0 legacy=0x7fb9000ae5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000cdc00 0x7fb8ec003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:32.405 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec004180 0x7fb8ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:32.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004d50 0x7fb8ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:32.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000cc390 con 0x7fb8ec004180 2023-09-28T00:16:32.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec00bba0 con 0x7fb8ec004d50 2023-09-28T00:16:32.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ec00bd60 con 0x7fb9000cdc00 2023-09-28T00:16:32.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8ff7fe700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec004180 0x7fb8ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:32.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb8fffff700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000cdc00 0x7fb8ec003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:32.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.400+0000 7fb904f67700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004d50 0x7fb8ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:32.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb8ff7fe700 1 -- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000cdc00 msgr2=0x7fb8ec003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:32.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb8ff7fe700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000cdc00 0x7fb8ec003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:32.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb8ff7fe700 1 -- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004d50 msgr2=0x7fb8ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:32.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb8ff7fe700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004d50 0x7fb8ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:32.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb8ff7fe700 1 -- 172.21.15.26:0/1852155522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ec003570 con 0x7fb8ec004180 2023-09-28T00:16:32.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb8ff7fe700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec004180 0x7fb8ec004810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8001a10 tx=0x7fb8e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c88db5807cf376c server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:32.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800c5d0 con 0x7fb8ec004180 2023-09-28T00:16:32.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e800c730 con 0x7fb8ec004180 2023-09-28T00:16:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb8feffd700 1 -- 172.21.15.26:0/1852155522 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e800cad0 con 0x7fb8ec004180 2023-09-28T00:16:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb9069ca700 1 -- 172.21.15.26:0/1852155522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec004180 msgr2=0x7fb8ec004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb9069ca700 1 --2- 172.21.15.26:0/1852155522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8ec004180 0x7fb8ec004810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8001a10 tx=0x7fb8e8007d30 comp rx=0 tx=0).stop 2023-09-28T00:16:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb904f67700 1 -- 172.21.15.26:0/1852155522 reap_dead start 2023-09-28T00:16:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb9069ca700 1 -- 172.21.15.26:0/1852155522 shutdown_connections 2023-09-28T00:16:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb9069ca700 1 -- 172.21.15.26:0/1852155522 >> 172.21.15.26:0/1852155522 conn(0x7fb900099990 msgr2=0x7fb9000b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.401+0000 7fb9069ca700 1 -- 172.21.15.26:0/1852155522 shutdown_connections 2023-09-28T00:16:32.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.402+0000 7fb9069ca700 1 -- 172.21.15.26:0/1852155522 wait complete. 2023-09-28T00:16:32.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.403+0000 7fb9069ca700 1 Processor -- start 2023-09-28T00:16:32.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.403+0000 7fb9069ca700 1 -- start start 2023-09-28T00:16:32.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb9069ca700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004180 0x7fb9001593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:32.411 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb9069ca700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000c99f0 0x7fb9000c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb9069ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900068a70 0x7fb900068ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb9069ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000ca3a0 con 0x7fb900068a70 2023-09-28T00:16:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb9069ca700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000697a0 con 0x7fb8ec004180 2023-09-28T00:16:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb9069ca700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb900069a80 con 0x7fb9000c99f0 2023-09-28T00:16:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb904f67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900068a70 0x7fb900068ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb904f67700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900068a70 0x7fb900068ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39318/0 (socket says 172.21.15.26:39318) 2023-09-28T00:16:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb904f67700 1 -- 172.21.15.26:0/810987412 learned_addr learned my addr 172.21.15.26:0/810987412 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:32.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb8fffff700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004180 0x7fb9001593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb8ff7fe700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000c99f0 0x7fb9000c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb904f67700 1 -- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000c99f0 msgr2=0x7fb9000c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb904f67700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000c99f0 0x7fb9000c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb904f67700 1 -- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004180 msgr2=0x7fb9001593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb904f67700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004180 0x7fb9001593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb904f67700 1 -- 172.21.15.26:0/810987412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb900069d60 con 0x7fb900068a70 2023-09-28T00:16:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb8fffff700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004180 0x7fb9001593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:16:32.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb904f67700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900068a70 0x7fb900068ee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000f80 tx=0x7fb8f8002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb8f7fff700 1 -- 172.21.15.26:0/810987412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800ad40 con 0x7fb900068a70 2023-09-28T00:16:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb8f7fff700 1 -- 172.21.15.26:0/810987412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f80133f0 con 0x7fb900068a70 2023-09-28T00:16:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90006a040 con 0x7fb900068a70 2023-09-28T00:16:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb8f7fff700 1 -- 172.21.15.26:0/810987412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800aea0 con 0x7fb900068a70 2023-09-28T00:16:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.404+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb900067630 con 0x7fb900068a70 2023-09-28T00:16:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.405+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb900064050 con 0x7fb900068a70 2023-09-28T00:16:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.406+0000 7fb8f7fff700 1 -- 172.21.15.26:0/810987412 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb8f8013a00 con 0x7fb900068a70 2023-09-28T00:16:32.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.406+0000 7fb8f7fff700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb8e0067330 0x7fb8e00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.406+0000 7fb8f7fff700 1 -- 172.21.15.26:0/810987412 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb8f80857d0 con 0x7fb900068a70 2023-09-28T00:16:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.406+0000 7fb8fffff700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb8e0067330 0x7fb8e00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.407+0000 7fb8fffff700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb8e0067330 0x7fb8e00697e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009390 tx=0x7fb8f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.411+0000 7fb8f7fff700 1 -- 172.21.15.26:0/810987412 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb8f8052690 con 0x7fb900068a70 2023-09-28T00:16:32.601 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.600+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb900089720 con 0x7fb8e0067330 2023-09-28T00:16:32.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.610+0000 7fb8f7fff700 1 -- 172.21.15.26:0/810987412 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310004 (secure 0 0 0) 0x7fb900089720 con 0x7fb8e0067330 2023-09-28T00:16:32.614 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:16:32.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb8e0067330 msgr2=0x7fb8e00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:32.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb8e0067330 0x7fb8e00697e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0009390 tx=0x7fb8f0008040 comp rx=0 tx=0).stop 2023-09-28T00:16:32.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900068a70 msgr2=0x7fb900068ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:32.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900068a70 0x7fb900068ee0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb8f8000f80 tx=0x7fb8f8002170 comp rx=0 tx=0).stop 2023-09-28T00:16:32.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 shutdown_connections 2023-09-28T00:16:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb8e0067330 0x7fb8e00697e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb900068a70 0x7fb900068ee0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb8ec004180 0x7fb9001593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 --2- 172.21.15.26:0/810987412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb9000c99f0 0x7fb9000c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 >> 172.21.15.26:0/810987412 conn(0x7fb900099990 msgr2=0x7fb9000ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 shutdown_connections 2023-09-28T00:16:32.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:32.613+0000 7fb9069ca700 1 -- 172.21.15.26:0/810987412 wait complete. 2023-09-28T00:16:32.619 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:16:32.626 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-09-28T00:16:31.682991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66920,"kb_used_data":3368,"kb_used_omap":0,"kb_used_meta":63488,"kb_avail":754907800,"statfs":{"total":773094113280,"available":773025587200,"internally_reserved":0,"allocated":3448832,"data_stored":2031972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65011712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003020"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023608+0000","last_change":"2023-09-28T00:15:56.267872+0000","last_active":"2023-09-28T00:16:10.023608+0000","last_peered":"2023-09-28T00:16:10.023608+0000","last_clean":"2023-09-28T00:16:10.023608+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:16:10.023608+0000","last_undegraded":"2023-09-28T00:16:10.023608+0000","last_fullsized":"2023-09-28T00:16:10.023608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:56.267743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:56.267743+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.267743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:45.165125+0000","scrub_duration":0.0017700940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022504+0000","last_change":"2023-09-28T00:15:29.385367+0000","last_active":"2023-09-28T00:16:10.022504+0000","last_peered":"2023-09-28T00:16:10.022504+0000","last_clean":"2023-09-28T00:16:10.022504+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:16:10.022504+0000","last_undegraded":"2023-09-28T00:16:10.022504+0000","last_fullsized":"2023-09-28T00:16:10.022504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.020047+0000","last_change":"2023-09-28T00:15:29.402774+0000","last_active":"2023-09-28T00:16:10.020047+0000","last_peered":"2023-09-28T00:16:10.020047+0000","last_clean":"2023-09-28T00:16:10.020047+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:16:10.020047+0000","last_undegraded":"2023-09-28T00:16:10.020047+0000","last_fullsized":"2023-09-28T00:16:10.020047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:16.155834+0000","last_change":"2023-09-28T00:16:16.155775+0000","last_active":"2023-09-28T00:16:16.155834+0000","last_peered":"2023-09-28T00:16:16.155834+0000","last_clean":"2023-09-28T00:16:16.155834+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:16:16.155834+0000","last_undegraded":"2023-09-28T00:16:16.155834+0000","last_fullsized":"2023-09-28T00:16:16.155834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:16.155665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:16.155665+0000","last_clean_scrub_stamp":"2023-09-28T00:16:16.155665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:16.135495+0000","scrub_duration":0.0019898139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230231+0000","last_change":"2023-09-28T00:15:29.398727+0000","last_active":"2023-09-28T00:16:10.230231+0000","last_peered":"2023-09-28T00:16:10.230231+0000","last_clean":"2023-09-28T00:16:10.230231+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:16:10.230231+0000","last_undegraded":"2023-09-28T00:16:10.230231+0000","last_fullsized":"2023-09-28T00:16:10.230231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019357+0000","last_change":"2023-09-28T00:15:29.399025+0000","last_active":"2023-09-28T00:16:10.019357+0000","last_peered":"2023-09-28T00:16:10.019357+0000","last_clean":"2023-09-28T00:16:10.019357+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:16:10.019357+0000","last_undegraded":"2023-09-28T00:16:10.019357+0000","last_fullsized":"2023-09-28T00:16:10.019357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018716+0000","last_change":"2023-09-28T00:15:29.386225+0000","last_active":"2023-09-28T00:16:10.018716+0000","last_peered":"2023-09-28T00:16:10.018716+0000","last_clean":"2023-09-28T00:16:10.018716+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:16:10.018716+0000","last_undegraded":"2023-09-28T00:16:10.018716+0000","last_fullsized":"2023-09-28T00:16:10.018716+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:27.358682+0000","last_change":"2023-09-28T00:16:27.358654+0000","last_active":"2023-09-28T00:16:27.358682+0000","last_peered":"2023-09-28T00:16:27.358682+0000","last_clean":"2023-09-28T00:16:27.358682+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:16:27.358682+0000","last_undegraded":"2023-09-28T00:16:27.358682+0000","last_fullsized":"2023-09-28T00:16:27.358682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:27.358538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:27.358538+0000","last_clean_scrub_stamp":"2023-09-28T00:16:27.358538+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:53:12.417572+0000","scrub_duration":0.0015811180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:28.396094+0000","last_change":"2023-09-28T00:16:28.396056+0000","last_active":"2023-09-28T00:16:28.396094+0000","last_peered":"2023-09-28T00:16:28.396094+0000","last_clean":"2023-09-28T00:16:28.396094+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:16:28.396094+0000","last_undegraded":"2023-09-28T00:16:28.396094+0000","last_fullsized":"2023-09-28T00:16:28.396094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:28.395934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:28.395934+0000","last_clean_scrub_stamp":"2023-09-28T00:16:28.395934+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:38:53.750131+0000","scrub_duration":0.0016835039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:17.377251+0000","last_change":"2023-09-28T00:16:17.377212+0000","last_active":"2023-09-28T00:16:17.377251+0000","last_peered":"2023-09-28T00:16:17.377251+0000","last_clean":"2023-09-28T00:16:17.377251+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:16:17.377251+0000","last_undegraded":"2023-09-28T00:16:17.377251+0000","last_fullsized":"2023-09-28T00:16:17.377251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:17.377100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:17.377100+0000","last_clean_scrub_stamp":"2023-09-28T00:16:17.377100+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:08.076087+0000","scrub_duration":0.0021518069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.020287+0000","last_change":"2023-09-28T00:15:29.395395+0000","last_active":"2023-09-28T00:16:10.020287+0000","last_peered":"2023-09-28T00:16:10.020287+0000","last_clean":"2023-09-28T00:16:10.020287+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:16:10.020287+0000","last_undegraded":"2023-09-28T00:16:10.020287+0000","last_fullsized":"2023-09-28T00:16:10.020287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023347+0000","last_change":"2023-09-28T00:15:54.316536+0000","last_active":"2023-09-28T00:16:10.023347+0000","last_peered":"2023-09-28T00:16:10.023347+0000","last_clean":"2023-09-28T00:16:10.023347+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:16:10.023347+0000","last_undegraded":"2023-09-28T00:16:10.023347+0000","last_fullsized":"2023-09-28T00:16:10.023347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:54.316397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:54.316397+0000","last_clean_scrub_stamp":"2023-09-28T00:15:54.316397+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:49:16.409521+0000","scrub_duration":0.002011128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023323+0000","last_change":"2023-09-28T00:15:51.344205+0000","last_active":"2023-09-28T00:16:10.023323+0000","last_peered":"2023-09-28T00:16:10.023323+0000","last_clean":"2023-09-28T00:16:10.023323+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:16:10.023323+0000","last_undegraded":"2023-09-28T00:16:10.023323+0000","last_fullsized":"2023-09-28T00:16:10.023323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:51.344105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:51.344105+0000","last_clean_scrub_stamp":"2023-09-28T00:15:51.344105+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:59.963637+0000","scrub_duration":0.001439826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:22.296538+0000","last_change":"2023-09-28T00:16:22.296509+0000","last_active":"2023-09-28T00:16:22.296538+0000","last_peered":"2023-09-28T00:16:22.296538+0000","last_clean":"2023-09-28T00:16:22.296538+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:16:22.296538+0000","last_undegraded":"2023-09-28T00:16:22.296538+0000","last_fullsized":"2023-09-28T00:16:22.296538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:22.296381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:22.296381+0000","last_clean_scrub_stamp":"2023-09-28T00:16:22.296381+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:52.197414+0000","scrub_duration":0.0020376249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018937+0000","last_change":"2023-09-28T00:15:29.391309+0000","last_active":"2023-09-28T00:16:10.018937+0000","last_peered":"2023-09-28T00:16:10.018937+0000","last_clean":"2023-09-28T00:16:10.018937+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:16:10.018937+0000","last_undegraded":"2023-09-28T00:16:10.018937+0000","last_fullsized":"2023-09-28T00:16:10.018937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019882+0000","last_change":"2023-09-28T00:15:58.202941+0000","last_active":"2023-09-28T00:16:10.019882+0000","last_peered":"2023-09-28T00:16:10.019882+0000","last_clean":"2023-09-28T00:16:10.019882+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:16:10.019882+0000","last_undegraded":"2023-09-28T00:16:10.019882+0000","last_fullsized":"2023-09-28T00:16:10.019882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:58.202825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:58.202825+0000","last_clean_scrub_stamp":"2023-09-28T00:15:58.202825+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:05:02.833041+0000","scrub_duration":0.0020265230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:17.528662+0000","last_change":"2023-09-28T00:16:17.528631+0000","last_active":"2023-09-28T00:16:17.528662+0000","last_peered":"2023-09-28T00:16:17.528662+0000","last_clean":"2023-09-28T00:16:17.528662+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:16:17.528662+0000","last_undegraded":"2023-09-28T00:16:17.528662+0000","last_fullsized":"2023-09-28T00:16:17.528662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:17.528525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:17.528525+0000","last_clean_scrub_stamp":"2023-09-28T00:16:17.528525+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:15:56.525290+0000","scrub_duration":0.0014540270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019794+0000","last_change":"2023-09-28T00:15:29.398472+0000","last_active":"2023-09-28T00:16:10.019794+0000","last_peered":"2023-09-28T00:16:10.019794+0000","last_clean":"2023-09-28T00:16:10.019794+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:16:10.019794+0000","last_undegraded":"2023-09-28T00:16:10.019794+0000","last_fullsized":"2023-09-28T00:16:10.019794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023480+0000","last_change":"2023-09-28T00:15:52.314313+0000","last_active":"2023-09-28T00:16:10.023480+0000","last_peered":"2023-09-28T00:16:10.023480+0000","last_clean":"2023-09-28T00:16:10.023480+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:16:10.023480+0000","last_undegraded":"2023-09-28T00:16:10.023480+0000","last_fullsized":"2023-09-28T00:16:10.023480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:52.314217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:52.314217+0000","last_clean_scrub_stamp":"2023-09-28T00:15:52.314217+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:22:43.890895+0000","scrub_duration":0.0018513100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.020028+0000","last_change":"2023-09-28T00:15:29.399492+0000","last_active":"2023-09-28T00:16:10.020028+0000","last_peered":"2023-09-28T00:16:10.020028+0000","last_clean":"2023-09-28T00:16:10.020028+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:16:10.020028+0000","last_undegraded":"2023-09-28T00:16:10.020028+0000","last_fullsized":"2023-09-28T00:16:10.020028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:25.911413+0000","last_change":"2023-09-28T00:16:25.911380+0000","last_active":"2023-09-28T00:16:25.911413+0000","last_peered":"2023-09-28T00:16:25.911413+0000","last_clean":"2023-09-28T00:16:25.911413+0000","last_became_active":"2023-09-28T00:16:11.427127+0000","last_became_peered":"2023-09-28T00:16:11.427127+0000","last_unstale":"2023-09-28T00:16:25.911413+0000","last_undegraded":"2023-09-28T00:16:25.911413+0000","last_fullsized":"2023-09-28T00:16:25.911413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:25.911277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:25.911277+0000","last_clean_scrub_stamp":"2023-09-28T00:16:25.911277+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:55.812310+0000","scrub_duration":0.0017471279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230272+0000","last_change":"2023-09-28T00:16:04.657359+0000","last_active":"2023-09-28T00:16:10.230272+0000","last_peered":"2023-09-28T00:16:10.230272+0000","last_clean":"2023-09-28T00:16:10.230272+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:16:10.230272+0000","last_undegraded":"2023-09-28T00:16:10.230272+0000","last_fullsized":"2023-09-28T00:16:10.230272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:04.657222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:04.657222+0000","last_clean_scrub_stamp":"2023-09-28T00:16:04.657222+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:31.711975+0000","scrub_duration":0.0016007720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017990+0000","last_change":"2023-09-28T00:16:04.886920+0000","last_active":"2023-09-28T00:16:10.017990+0000","last_peered":"2023-09-28T00:16:10.017990+0000","last_clean":"2023-09-28T00:16:10.017990+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:16:10.017990+0000","last_undegraded":"2023-09-28T00:16:10.017990+0000","last_fullsized":"2023-09-28T00:16:10.017990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:04.886808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:04.886808+0000","last_clean_scrub_stamp":"2023-09-28T00:16:04.886808+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:04.866638+0000","scrub_duration":0.001535238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018744+0000","last_change":"2023-09-28T00:15:29.392532+0000","last_active":"2023-09-28T00:16:10.018744+0000","last_peered":"2023-09-28T00:16:10.018744+0000","last_clean":"2023-09-28T00:16:10.018744+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:16:10.018744+0000","last_undegraded":"2023-09-28T00:16:10.018744+0000","last_fullsized":"2023-09-28T00:16:10.018744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:21.647104+0000","last_change":"2023-09-28T00:16:21.647070+0000","last_active":"2023-09-28T00:16:21.647104+0000","last_peered":"2023-09-28T00:16:21.647104+0000","last_clean":"2023-09-28T00:16:21.647104+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:16:21.647104+0000","last_undegraded":"2023-09-28T00:16:21.647104+0000","last_fullsized":"2023-09-28T00:16:21.647104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:21.646960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:21.646960+0000","last_clean_scrub_stamp":"2023-09-28T00:16:21.646960+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:16:00.643725+0000","scrub_duration":0.0021571820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025140+0000","last_change":"2023-09-28T00:16:03.620852+0000","last_active":"2023-09-28T00:16:10.025140+0000","last_peered":"2023-09-28T00:16:10.025140+0000","last_clean":"2023-09-28T00:16:10.025140+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:16:10.025140+0000","last_undegraded":"2023-09-28T00:16:10.025140+0000","last_fullsized":"2023-09-28T00:16:10.025140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:03.620725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:03.620725+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.620725+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:51.918523+0000","scrub_duration":0.0017002300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022256+0000","last_change":"2023-09-28T00:15:29.396440+0000","last_active":"2023-09-28T00:16:10.022256+0000","last_peered":"2023-09-28T00:16:10.022256+0000","last_clean":"2023-09-28T00:16:10.022256+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:16:10.022256+0000","last_undegraded":"2023-09-28T00:16:10.022256+0000","last_fullsized":"2023-09-28T00:16:10.022256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.141337+0000","last_change":"2023-09-28T00:16:11.141295+0000","last_active":"2023-09-28T00:16:11.141337+0000","last_peered":"2023-09-28T00:16:11.141337+0000","last_clean":"2023-09-28T00:16:11.141337+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:16:11.141337+0000","last_undegraded":"2023-09-28T00:16:11.141337+0000","last_fullsized":"2023-09-28T00:16:11.141337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-09-28T00:16:11.141186+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-09-28T00:16:11.141186+0000","last_clean_scrub_stamp":"2023-09-28T00:16:11.141186+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:01.840172+0000","scrub_duration":0.001800669,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018485+0000","last_change":"2023-09-28T00:16:01.926267+0000","last_active":"2023-09-28T00:16:10.018485+0000","last_peered":"2023-09-28T00:16:10.018485+0000","last_clean":"2023-09-28T00:16:10.018485+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:16:10.018485+0000","last_undegraded":"2023-09-28T00:16:10.018485+0000","last_fullsized":"2023-09-28T00:16:10.018485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:01.926150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:01.926150+0000","last_clean_scrub_stamp":"2023-09-28T00:16:01.926150+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:12:25.987525+0000","scrub_duration":0.0015574779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.024727+0000","last_change":"2023-09-28T00:15:55.616876+0000","last_active":"2023-09-28T00:16:10.024727+0000","last_peered":"2023-09-28T00:16:10.024727+0000","last_clean":"2023-09-28T00:16:10.024727+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:16:10.024727+0000","last_undegraded":"2023-09-28T00:16:10.024727+0000","last_fullsized":"2023-09-28T00:16:10.024727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:55.616759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:55.616759+0000","last_clean_scrub_stamp":"2023-09-28T00:15:55.616759+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:32:29.805704+0000","scrub_duration":0.00169892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230651+0000","last_change":"2023-09-28T00:15:29.399205+0000","last_active":"2023-09-28T00:16:10.230651+0000","last_peered":"2023-09-28T00:16:10.230651+0000","last_clean":"2023-09-28T00:16:10.230651+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:16:10.230651+0000","last_undegraded":"2023-09-28T00:16:10.230651+0000","last_fullsized":"2023-09-28T00:16:10.230651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017777+0000","last_change":"2023-09-28T00:15:56.876590+0000","last_active":"2023-09-28T00:16:10.017777+0000","last_peered":"2023-09-28T00:16:10.017777+0000","last_clean":"2023-09-28T00:16:10.017777+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:16:10.017777+0000","last_undegraded":"2023-09-28T00:16:10.017777+0000","last_fullsized":"2023-09-28T00:16:10.017777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:56.876455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:56.876455+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.876455+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:14.468136+0000","scrub_duration":0.0015522699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230125+0000","last_change":"2023-09-28T00:16:05.256890+0000","last_active":"2023-09-28T00:16:10.230125+0000","last_peered":"2023-09-28T00:16:10.230125+0000","last_clean":"2023-09-28T00:16:10.230125+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:16:10.230125+0000","last_undegraded":"2023-09-28T00:16:10.230125+0000","last_fullsized":"2023-09-28T00:16:10.230125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.256766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.256766+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.256766+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:54.999721+0000","scrub_duration":0.0015163100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230765+0000","last_change":"2023-09-28T00:15:59.709473+0000","last_active":"2023-09-28T00:16:10.230765+0000","last_peered":"2023-09-28T00:16:10.230765+0000","last_clean":"2023-09-28T00:16:10.230765+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:16:10.230765+0000","last_undegraded":"2023-09-28T00:16:10.230765+0000","last_fullsized":"2023-09-28T00:16:10.230765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:59.709361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:59.709361+0000","last_clean_scrub_stamp":"2023-09-28T00:15:59.709361+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:48.007160+0000","scrub_duration":0.0020169540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017768+0000","last_change":"2023-09-28T00:16:05.850253+0000","last_active":"2023-09-28T00:16:10.017768+0000","last_peered":"2023-09-28T00:16:10.017768+0000","last_clean":"2023-09-28T00:16:10.017768+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:16:10.017768+0000","last_undegraded":"2023-09-28T00:16:10.017768+0000","last_fullsized":"2023-09-28T00:16:10.017768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.850133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.850133+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.850133+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:32.904885+0000","scrub_duration":0.00147853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022513+0000","last_change":"2023-09-28T00:16:09.443171+0000","last_active":"2023-09-28T00:16:10.022513+0000","last_peered":"2023-09-28T00:16:10.022513+0000","last_clean":"2023-09-28T00:16:10.022513+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:16:10.022513+0000","last_undegraded":"2023-09-28T00:16:10.022513+0000","last_fullsized":"2023-09-28T00:16:10.022513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:09.443032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:09.443032+0000","last_clean_scrub_stamp":"2023-09-28T00:16:09.443032+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:36.497785+0000","scrub_duration":0.00158618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017873+0000","last_change":"2023-09-28T00:15:29.388831+0000","last_active":"2023-09-28T00:16:10.017873+0000","last_peered":"2023-09-28T00:16:10.017873+0000","last_clean":"2023-09-28T00:16:10.017873+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:16:10.017873+0000","last_undegraded":"2023-09-28T00:16:10.017873+0000","last_fullsized":"2023-09-28T00:16:10.017873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:23.875142+0000","last_change":"2023-09-28T00:16:23.875097+0000","last_active":"2023-09-28T00:16:23.875142+0000","last_peered":"2023-09-28T00:16:23.875142+0000","last_clean":"2023-09-28T00:16:23.875142+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:16:23.875142+0000","last_undegraded":"2023-09-28T00:16:23.875142+0000","last_fullsized":"2023-09-28T00:16:23.875142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2023-09-28T00:16:23.874994+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2023-09-28T00:16:23.874994+0000","last_clean_scrub_stamp":"2023-09-28T00:16:23.874994+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:16:02.871759+0000","scrub_duration":0.0041905149999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:24.645540+0000","last_change":"2023-09-28T00:16:24.645486+0000","last_active":"2023-09-28T00:16:24.645540+0000","last_peered":"2023-09-28T00:16:24.645540+0000","last_clean":"2023-09-28T00:16:24.645540+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:16:24.645540+0000","last_undegraded":"2023-09-28T00:16:24.645540+0000","last_fullsized":"2023-09-28T00:16:24.645540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:24.645361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:24.645361+0000","last_clean_scrub_stamp":"2023-09-28T00:16:24.645361+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:54.546394+0000","scrub_duration":0.002349795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'10","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:13.095052+0000","last_change":"2023-09-28T00:16:13.095001+0000","last_active":"2023-09-28T00:16:13.095052+0000","last_peered":"2023-09-28T00:16:13.095052+0000","last_clean":"2023-09-28T00:16:13.095052+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:16:13.095052+0000","last_undegraded":"2023-09-28T00:16:13.095052+0000","last_fullsized":"2023-09-28T00:16:13.095052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2023-09-28T00:16:13.094891+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2023-09-28T00:16:13.094891+0000","last_clean_scrub_stamp":"2023-09-28T00:16:13.094891+0000","objects_scrubbed":4,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:15:52.091656+0000","scrub_duration":0.0068571760000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019699+0000","last_change":"2023-09-28T00:15:29.400146+0000","last_active":"2023-09-28T00:16:10.019699+0000","last_peered":"2023-09-28T00:16:10.019699+0000","last_clean":"2023-09-28T00:16:10.019699+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:16:10.019699+0000","last_undegraded":"2023-09-28T00:16:10.019699+0000","last_fullsized":"2023-09-28T00:16:10.019699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:12.815843+0000","last_change":"2023-09-28T00:16:12.815812+0000","last_active":"2023-09-28T00:16:12.815843+0000","last_peered":"2023-09-28T00:16:12.815843+0000","last_clean":"2023-09-28T00:16:12.815843+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:16:12.815843+0000","last_undegraded":"2023-09-28T00:16:12.815843+0000","last_fullsized":"2023-09-28T00:16:12.815843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2023-09-28T00:16:12.815704+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2023-09-28T00:16:12.815704+0000","last_clean_scrub_stamp":"2023-09-28T00:16:12.815704+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:39.870457+0000","scrub_duration":0.0060367390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:20.882824+0000","last_change":"2023-09-28T00:16:20.882793+0000","last_active":"2023-09-28T00:16:20.882824+0000","last_peered":"2023-09-28T00:16:20.882824+0000","last_clean":"2023-09-28T00:16:20.882824+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:16:20.882824+0000","last_undegraded":"2023-09-28T00:16:20.882824+0000","last_fullsized":"2023-09-28T00:16:20.882824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:20.882680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:20.882680+0000","last_clean_scrub_stamp":"2023-09-28T00:16:20.882680+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:23.940800+0000","scrub_duration":0.001535137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230230+0000","last_change":"2023-09-28T00:15:48.622966+0000","last_active":"2023-09-28T00:16:10.230230+0000","last_peered":"2023-09-28T00:16:10.230230+0000","last_clean":"2023-09-28T00:16:10.230230+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:16:10.230230+0000","last_undegraded":"2023-09-28T00:16:10.230230+0000","last_fullsized":"2023-09-28T00:16:10.230230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:48.622809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:48.622809+0000","last_clean_scrub_stamp":"2023-09-28T00:15:48.622809+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:04:59.170139+0000","scrub_duration":0.0017786600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:21.269798+0000","last_change":"2023-09-28T00:16:21.269769+0000","last_active":"2023-09-28T00:16:21.269798+0000","last_peered":"2023-09-28T00:16:21.269798+0000","last_clean":"2023-09-28T00:16:21.269798+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:16:21.269798+0000","last_undegraded":"2023-09-28T00:16:21.269798+0000","last_fullsized":"2023-09-28T00:16:21.269798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:21.269658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:21.269658+0000","last_clean_scrub_stamp":"2023-09-28T00:16:21.269658+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:24.327778+0000","scrub_duration":0.00139431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.822261+0000","last_change":"2023-09-28T00:16:11.822235+0000","last_active":"2023-09-28T00:16:11.822261+0000","last_peered":"2023-09-28T00:16:11.822261+0000","last_clean":"2023-09-28T00:16:11.822261+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:16:11.822261+0000","last_undegraded":"2023-09-28T00:16:11.822261+0000","last_fullsized":"2023-09-28T00:16:11.822261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:11.822134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:11.822134+0000","last_clean_scrub_stamp":"2023-09-28T00:16:11.822134+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:11.801964+0000","scrub_duration":0.0015678759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230585+0000","last_change":"2023-09-28T00:15:29.399423+0000","last_active":"2023-09-28T00:16:10.230585+0000","last_peered":"2023-09-28T00:16:10.230585+0000","last_clean":"2023-09-28T00:16:10.230585+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:16:10.230585+0000","last_undegraded":"2023-09-28T00:16:10.230585+0000","last_fullsized":"2023-09-28T00:16:10.230585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.229752+0000","last_change":"2023-09-28T00:15:56.332960+0000","last_active":"2023-09-28T00:16:10.229752+0000","last_peered":"2023-09-28T00:16:10.229752+0000","last_clean":"2023-09-28T00:16:10.229752+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:16:10.229752+0000","last_undegraded":"2023-09-28T00:16:10.229752+0000","last_fullsized":"2023-09-28T00:16:10.229752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2023-09-28T00:15:56.332853+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2023-09-28T00:15:56.332853+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.332853+0000","objects_scrubbed":4,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:45.230235+0000","scrub_duration":0.0027676580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:18.843081+0000","last_change":"2023-09-28T00:16:18.843034+0000","last_active":"2023-09-28T00:16:18.843081+0000","last_peered":"2023-09-28T00:16:18.843081+0000","last_clean":"2023-09-28T00:16:18.843081+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:16:18.843081+0000","last_undegraded":"2023-09-28T00:16:18.843081+0000","last_fullsized":"2023-09-28T00:16:18.843081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:18.842921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:18.842921+0000","last_clean_scrub_stamp":"2023-09-28T00:16:18.842921+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:15:57.839685+0000","scrub_duration":0.001917796,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:16.891280+0000","last_change":"2023-09-28T00:16:16.891250+0000","last_active":"2023-09-28T00:16:16.891280+0000","last_peered":"2023-09-28T00:16:16.891280+0000","last_clean":"2023-09-28T00:16:16.891280+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:16:16.891280+0000","last_undegraded":"2023-09-28T00:16:16.891280+0000","last_fullsized":"2023-09-28T00:16:16.891280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-09-28T00:16:16.891131+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-09-28T00:16:16.891131+0000","last_clean_scrub_stamp":"2023-09-28T00:16:16.891131+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:36:20.909174+0000","scrub_duration":0.0030910569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:19.327428+0000","last_change":"2023-09-28T00:16:19.327391+0000","last_active":"2023-09-28T00:16:19.327428+0000","last_peered":"2023-09-28T00:16:19.327428+0000","last_clean":"2023-09-28T00:16:19.327428+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:16:19.327428+0000","last_undegraded":"2023-09-28T00:16:19.327428+0000","last_fullsized":"2023-09-28T00:16:19.327428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:19.327292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:19.327292+0000","last_clean_scrub_stamp":"2023-09-28T00:16:19.327292+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:15:58.324056+0000","scrub_duration":0.001328889,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:22.890472+0000","last_change":"2023-09-28T00:16:22.890422+0000","last_active":"2023-09-28T00:16:22.890472+0000","last_peered":"2023-09-28T00:16:22.890472+0000","last_clean":"2023-09-28T00:16:22.890472+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:16:22.890472+0000","last_undegraded":"2023-09-28T00:16:22.890472+0000","last_fullsized":"2023-09-28T00:16:22.890472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-09-28T00:16:22.890296+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-09-28T00:16:22.890296+0000","last_clean_scrub_stamp":"2023-09-28T00:16:22.890296+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:02:23.281419+0000","scrub_duration":0.0030682890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019480+0000","last_change":"2023-09-28T00:15:29.393884+0000","last_active":"2023-09-28T00:16:10.019480+0000","last_peered":"2023-09-28T00:16:10.019480+0000","last_clean":"2023-09-28T00:16:10.019480+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:16:10.019480+0000","last_undegraded":"2023-09-28T00:16:10.019480+0000","last_fullsized":"2023-09-28T00:16:10.019480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:20.922896+0000","last_change":"2023-09-28T00:16:20.922865+0000","last_active":"2023-09-28T00:16:20.922896+0000","last_peered":"2023-09-28T00:16:20.922896+0000","last_clean":"2023-09-28T00:16:20.922896+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:16:20.922896+0000","last_undegraded":"2023-09-28T00:16:20.922896+0000","last_fullsized":"2023-09-28T00:16:20.922896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-09-28T00:16:20.922756+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-09-28T00:16:20.922756+0000","last_clean_scrub_stamp":"2023-09-28T00:16:20.922756+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:48.347984+0000","scrub_duration":0.0029637520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:13.119163+0000","last_change":"2023-09-28T00:16:13.119137+0000","last_active":"2023-09-28T00:16:13.119163+0000","last_peered":"2023-09-28T00:16:13.119163+0000","last_clean":"2023-09-28T00:16:13.119163+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:16:13.119163+0000","last_undegraded":"2023-09-28T00:16:13.119163+0000","last_fullsized":"2023-09-28T00:16:13.119163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:13.119037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:13.119037+0000","last_clean_scrub_stamp":"2023-09-28T00:16:13.119037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:12:37.180413+0000","scrub_duration":0.0020019500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022341+0000","last_change":"2023-09-28T00:16:08.420377+0000","last_active":"2023-09-28T00:16:10.022341+0000","last_peered":"2023-09-28T00:16:10.022341+0000","last_clean":"2023-09-28T00:16:10.022341+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:16:10.022341+0000","last_undegraded":"2023-09-28T00:16:10.022341+0000","last_fullsized":"2023-09-28T00:16:10.022341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:08.420273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:08.420273+0000","last_clean_scrub_stamp":"2023-09-28T00:16:08.420273+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:08.400103+0000","scrub_duration":0.001767086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:19.538406+0000","last_change":"2023-09-28T00:16:19.538359+0000","last_active":"2023-09-28T00:16:19.538406+0000","last_peered":"2023-09-28T00:16:19.538406+0000","last_clean":"2023-09-28T00:16:19.538406+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:16:19.538406+0000","last_undegraded":"2023-09-28T00:16:19.538406+0000","last_fullsized":"2023-09-28T00:16:19.538406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:19.538238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:19.538238+0000","last_clean_scrub_stamp":"2023-09-28T00:16:19.538238+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:22.596358+0000","scrub_duration":0.0015910309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018635+0000","last_change":"2023-09-28T00:15:53.885189+0000","last_active":"2023-09-28T00:16:10.018635+0000","last_peered":"2023-09-28T00:16:10.018635+0000","last_clean":"2023-09-28T00:16:10.018635+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:16:10.018635+0000","last_undegraded":"2023-09-28T00:16:10.018635+0000","last_fullsized":"2023-09-28T00:16:10.018635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-28T00:15:53.885072+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-28T00:15:53.885072+0000","last_clean_scrub_stamp":"2023-09-28T00:15:53.885072+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:43.628028+0000","scrub_duration":0.0020480469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.020155+0000","last_change":"2023-09-28T00:15:53.159199+0000","last_active":"2023-09-28T00:16:10.020155+0000","last_peered":"2023-09-28T00:16:10.020155+0000","last_clean":"2023-09-28T00:16:10.020155+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:16:10.020155+0000","last_undegraded":"2023-09-28T00:16:10.020155+0000","last_fullsized":"2023-09-28T00:16:10.020155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:53.159094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:53.159094+0000","last_clean_scrub_stamp":"2023-09-28T00:15:53.159094+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:10.750775+0000","scrub_duration":0.0021930320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.229888+0000","last_change":"2023-09-28T00:16:03.295793+0000","last_active":"2023-09-28T00:16:10.229888+0000","last_peered":"2023-09-28T00:16:10.229888+0000","last_clean":"2023-09-28T00:16:10.229888+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:16:10.229888+0000","last_undegraded":"2023-09-28T00:16:10.229888+0000","last_fullsized":"2023-09-28T00:16:10.229888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:03.295686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:03.295686+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.295686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:32:37.484631+0000","scrub_duration":0.0016463370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:21.085990+0000","last_change":"2023-09-28T00:16:21.085959+0000","last_active":"2023-09-28T00:16:21.085990+0000","last_peered":"2023-09-28T00:16:21.085990+0000","last_clean":"2023-09-28T00:16:21.085990+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:16:21.085990+0000","last_undegraded":"2023-09-28T00:16:21.085990+0000","last_fullsized":"2023-09-28T00:16:21.085990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:21.085837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:21.085837+0000","last_clean_scrub_stamp":"2023-09-28T00:16:21.085837+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:53:06.144871+0000","scrub_duration":0.0018921859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019573+0000","last_change":"2023-09-28T00:16:01.173298+0000","last_active":"2023-09-28T00:16:10.019573+0000","last_peered":"2023-09-28T00:16:10.019573+0000","last_clean":"2023-09-28T00:16:10.019573+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:16:10.019573+0000","last_undegraded":"2023-09-28T00:16:10.019573+0000","last_fullsized":"2023-09-28T00:16:10.019573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:01.173171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:01.173171+0000","last_clean_scrub_stamp":"2023-09-28T00:16:01.173171+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:28.227924+0000","scrub_duration":0.0020952499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.020044+0000","last_change":"2023-09-28T00:16:00.181152+0000","last_active":"2023-09-28T00:16:10.020044+0000","last_peered":"2023-09-28T00:16:10.020044+0000","last_clean":"2023-09-28T00:16:10.020044+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:16:10.020044+0000","last_undegraded":"2023-09-28T00:16:10.020044+0000","last_fullsized":"2023-09-28T00:16:10.020044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:00.181000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:00.181000+0000","last_clean_scrub_stamp":"2023-09-28T00:16:00.181000+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:00.160829+0000","scrub_duration":0.0017584429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017681+0000","last_change":"2023-09-28T00:15:49.877522+0000","last_active":"2023-09-28T00:16:10.017681+0000","last_peered":"2023-09-28T00:16:10.017681+0000","last_clean":"2023-09-28T00:16:10.017681+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:16:10.017681+0000","last_undegraded":"2023-09-28T00:16:10.017681+0000","last_fullsized":"2023-09-28T00:16:10.017681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:49.877418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:49.877418+0000","last_clean_scrub_stamp":"2023-09-28T00:15:49.877418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:05:00.424748+0000","scrub_duration":0.0014756789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.023638+0000","last_change":"2023-09-28T00:16:11.023638+0000","last_active":"2023-09-28T00:16:11.023638+0000","last_peered":"2023-09-28T00:16:11.023638+0000","last_clean":"2023-09-28T00:16:11.023638+0000","last_became_active":"2023-09-28T00:16:11.023326+0000","last_became_peered":"2023-09-28T00:16:11.023326+0000","last_unstale":"2023-09-28T00:16:11.023638+0000","last_undegraded":"2023-09-28T00:16:11.023638+0000","last_fullsized":"2023-09-28T00:16:11.023638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:08.509135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:08.509135+0000","last_clean_scrub_stamp":"2023-09-28T00:16:08.509135+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:14.615373+0000","scrub_duration":0.001728788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025013+0000","last_change":"2023-09-28T00:15:48.686393+0000","last_active":"2023-09-28T00:16:10.025013+0000","last_peered":"2023-09-28T00:16:10.025013+0000","last_clean":"2023-09-28T00:16:10.025013+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:16:10.025013+0000","last_undegraded":"2023-09-28T00:16:10.025013+0000","last_fullsized":"2023-09-28T00:16:10.025013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:48.686304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:48.686304+0000","last_clean_scrub_stamp":"2023-09-28T00:15:48.686304+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:37.583686+0000","scrub_duration":0.0013027640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:15.364417+0000","last_change":"2023-09-28T00:16:15.364382+0000","last_active":"2023-09-28T00:16:15.364417+0000","last_peered":"2023-09-28T00:16:15.364417+0000","last_clean":"2023-09-28T00:16:15.364417+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:16:15.364417+0000","last_undegraded":"2023-09-28T00:16:15.364417+0000","last_fullsized":"2023-09-28T00:16:15.364417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:15.364267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:15.364267+0000","last_clean_scrub_stamp":"2023-09-28T00:16:15.364267+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:42.789495+0000","scrub_duration":0.001565421,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.024765+0000","last_change":"2023-09-28T00:16:05.593506+0000","last_active":"2023-09-28T00:16:10.024765+0000","last_peered":"2023-09-28T00:16:10.024765+0000","last_clean":"2023-09-28T00:16:10.024765+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:16:10.024765+0000","last_undegraded":"2023-09-28T00:16:10.024765+0000","last_fullsized":"2023-09-28T00:16:10.024765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.593397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.593397+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.593397+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:05:10.223613+0000","scrub_duration":0.0020412870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022038+0000","last_change":"2023-09-28T00:16:00.498971+0000","last_active":"2023-09-28T00:16:10.022038+0000","last_peered":"2023-09-28T00:16:10.022038+0000","last_clean":"2023-09-28T00:16:10.022038+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:16:10.022038+0000","last_undegraded":"2023-09-28T00:16:10.022038+0000","last_fullsized":"2023-09-28T00:16:10.022038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:00.498859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:00.498859+0000","last_clean_scrub_stamp":"2023-09-28T00:16:00.498859+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:18.090540+0000","scrub_duration":0.0020023010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019966+0000","last_change":"2023-09-28T00:16:05.136936+0000","last_active":"2023-09-28T00:16:10.019966+0000","last_peered":"2023-09-28T00:16:10.019966+0000","last_clean":"2023-09-28T00:16:10.019966+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:16:10.019966+0000","last_undegraded":"2023-09-28T00:16:10.019966+0000","last_fullsized":"2023-09-28T00:16:10.019966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.136820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.136820+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.136820+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:36:09.154862+0000","scrub_duration":0.00184125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025056+0000","last_change":"2023-09-28T00:16:07.548108+0000","last_active":"2023-09-28T00:16:10.025056+0000","last_peered":"2023-09-28T00:16:10.025056+0000","last_clean":"2023-09-28T00:16:10.025056+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:16:10.025056+0000","last_undegraded":"2023-09-28T00:16:10.025056+0000","last_fullsized":"2023-09-28T00:16:10.025056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:07.548002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:07.548002+0000","last_clean_scrub_stamp":"2023-09-28T00:16:07.548002+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:07.527832+0000","scrub_duration":0.001605205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023165+0000","last_change":"2023-09-28T00:15:49.304707+0000","last_active":"2023-09-28T00:16:10.023165+0000","last_peered":"2023-09-28T00:16:10.023165+0000","last_clean":"2023-09-28T00:16:10.023165+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:16:10.023165+0000","last_undegraded":"2023-09-28T00:16:10.023165+0000","last_fullsized":"2023-09-28T00:16:10.023165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:49.304605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:49.304605+0000","last_clean_scrub_stamp":"2023-09-28T00:15:49.304605+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:31.322663+0000","scrub_duration":0.0012867289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.024542+0000","last_change":"2023-09-28T00:16:00.590315+0000","last_active":"2023-09-28T00:16:10.024542+0000","last_peered":"2023-09-28T00:16:10.024542+0000","last_clean":"2023-09-28T00:16:10.024542+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:16:10.024542+0000","last_undegraded":"2023-09-28T00:16:10.024542+0000","last_fullsized":"2023-09-28T00:16:10.024542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:00.590197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:00.590197+0000","last_clean_scrub_stamp":"2023-09-28T00:16:00.590197+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:18.181878+0000","scrub_duration":0.0017790499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:19.616202+0000","last_change":"2023-09-28T00:16:19.616163+0000","last_active":"2023-09-28T00:16:19.616202+0000","last_peered":"2023-09-28T00:16:19.616202+0000","last_clean":"2023-09-28T00:16:19.616202+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:16:19.616202+0000","last_undegraded":"2023-09-28T00:16:19.616202+0000","last_fullsized":"2023-09-28T00:16:19.616202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:19.616063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:19.616063+0000","last_clean_scrub_stamp":"2023-09-28T00:16:19.616063+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:10.315049+0000","scrub_duration":0.0017686920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022188+0000","last_change":"2023-09-28T00:15:55.506327+0000","last_active":"2023-09-28T00:16:10.022188+0000","last_peered":"2023-09-28T00:16:10.022188+0000","last_clean":"2023-09-28T00:16:10.022188+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:16:10.022188+0000","last_undegraded":"2023-09-28T00:16:10.022188+0000","last_fullsized":"2023-09-28T00:16:10.022188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:55.506216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:55.506216+0000","last_clean_scrub_stamp":"2023-09-28T00:15:55.506216+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:34.313252+0000","scrub_duration":0.0022483070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":181,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018670+0000","last_change":"2023-09-28T00:15:58.809117+0000","last_active":"2023-09-28T00:16:10.018670+0000","last_peered":"2023-09-28T00:16:10.018670+0000","last_clean":"2023-09-28T00:16:10.018670+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:16:10.018670+0000","last_undegraded":"2023-09-28T00:16:10.018670+0000","last_fullsized":"2023-09-28T00:16:10.018670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2023-09-28T00:15:58.809014+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2023-09-28T00:15:58.809014+0000","last_clean_scrub_stamp":"2023-09-28T00:15:58.809014+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:37.616051+0000","scrub_duration":0.0056860469999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018035+0000","last_change":"2023-09-28T00:15:51.870215+0000","last_active":"2023-09-28T00:16:10.018035+0000","last_peered":"2023-09-28T00:16:10.018035+0000","last_clean":"2023-09-28T00:16:10.018035+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:16:10.018035+0000","last_undegraded":"2023-09-28T00:16:10.018035+0000","last_fullsized":"2023-09-28T00:16:10.018035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:51.870131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:51.870131+0000","last_clean_scrub_stamp":"2023-09-28T00:15:51.870131+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:32:26.059076+0000","scrub_duration":0.0018609810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.156585+0000","last_change":"2023-09-28T00:16:11.156557+0000","last_active":"2023-09-28T00:16:11.156585+0000","last_peered":"2023-09-28T00:16:11.156585+0000","last_clean":"2023-09-28T00:16:11.156585+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:16:11.156585+0000","last_undegraded":"2023-09-28T00:16:11.156585+0000","last_fullsized":"2023-09-28T00:16:11.156585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:11.156450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:11.156450+0000","last_clean_scrub_stamp":"2023-09-28T00:16:11.156450+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:59.454248+0000","scrub_duration":0.0040147280000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018831+0000","last_change":"2023-09-28T00:16:03.753189+0000","last_active":"2023-09-28T00:16:10.018831+0000","last_peered":"2023-09-28T00:16:10.018831+0000","last_clean":"2023-09-28T00:16:10.018831+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:16:10.018831+0000","last_undegraded":"2023-09-28T00:16:10.018831+0000","last_fullsized":"2023-09-28T00:16:10.018831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:03.753087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:03.753087+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.753087+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:21.344768+0000","scrub_duration":0.0022902560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230180+0000","last_change":"2023-09-28T00:16:01.732279+0000","last_active":"2023-09-28T00:16:10.230180+0000","last_peered":"2023-09-28T00:16:10.230180+0000","last_clean":"2023-09-28T00:16:10.230180+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:16:10.230180+0000","last_undegraded":"2023-09-28T00:16:10.230180+0000","last_fullsized":"2023-09-28T00:16:10.230180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:01.732160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:01.732160+0000","last_clean_scrub_stamp":"2023-09-28T00:16:01.732160+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:05:06.362375+0000","scrub_duration":0.0018186770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:15.572369+0000","last_change":"2023-09-28T00:16:15.572323+0000","last_active":"2023-09-28T00:16:15.572369+0000","last_peered":"2023-09-28T00:16:15.572369+0000","last_clean":"2023-09-28T00:16:15.572369+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:16:15.572369+0000","last_undegraded":"2023-09-28T00:16:15.572369+0000","last_fullsized":"2023-09-28T00:16:15.572369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:15.572201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:15.572201+0000","last_clean_scrub_stamp":"2023-09-28T00:16:15.572201+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:06.271188+0000","scrub_duration":0.001609982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019896+0000","last_change":"2023-09-28T00:16:06.787743+0000","last_active":"2023-09-28T00:16:10.019896+0000","last_peered":"2023-09-28T00:16:10.019896+0000","last_clean":"2023-09-28T00:16:10.019896+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:16:10.019896+0000","last_undegraded":"2023-09-28T00:16:10.019896+0000","last_fullsized":"2023-09-28T00:16:10.019896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:06.787615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:06.787615+0000","last_clean_scrub_stamp":"2023-09-28T00:16:06.787615+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:55.085413+0000","scrub_duration":0.002110392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025118+0000","last_change":"2023-09-28T00:15:57.594832+0000","last_active":"2023-09-28T00:16:10.025118+0000","last_peered":"2023-09-28T00:16:10.025118+0000","last_clean":"2023-09-28T00:16:10.025118+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:16:10.025118+0000","last_undegraded":"2023-09-28T00:16:10.025118+0000","last_fullsized":"2023-09-28T00:16:10.025118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:57.594711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:57.594711+0000","last_clean_scrub_stamp":"2023-09-28T00:15:57.594711+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:47.337667+0000","scrub_duration":0.001619428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:20.512282+0000","last_change":"2023-09-28T00:16:20.512235+0000","last_active":"2023-09-28T00:16:20.512282+0000","last_peered":"2023-09-28T00:16:20.512282+0000","last_clean":"2023-09-28T00:16:20.512282+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:16:20.512282+0000","last_undegraded":"2023-09-28T00:16:20.512282+0000","last_fullsized":"2023-09-28T00:16:20.512282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:20.512121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:20.512121+0000","last_clean_scrub_stamp":"2023-09-28T00:16:20.512121+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:50.413154+0000","scrub_duration":0.0018353989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018329+0000","last_change":"2023-09-28T00:15:52.853832+0000","last_active":"2023-09-28T00:16:10.018329+0000","last_peered":"2023-09-28T00:16:10.018329+0000","last_clean":"2023-09-28T00:16:10.018329+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:16:10.018329+0000","last_undegraded":"2023-09-28T00:16:10.018329+0000","last_fullsized":"2023-09-28T00:16:10.018329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-28T00:15:52.853723+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-28T00:15:52.853723+0000","last_clean_scrub_stamp":"2023-09-28T00:15:52.853723+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:31.660759+0000","scrub_duration":0.0022132520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025138+0000","last_change":"2023-09-28T00:15:52.639926+0000","last_active":"2023-09-28T00:16:10.025138+0000","last_peered":"2023-09-28T00:16:10.025138+0000","last_clean":"2023-09-28T00:16:10.025138+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:16:10.025138+0000","last_undegraded":"2023-09-28T00:16:10.025138+0000","last_fullsized":"2023-09-28T00:16:10.025138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:52.639814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:52.639814+0000","last_clean_scrub_stamp":"2023-09-28T00:15:52.639814+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:05:03.187143+0000","scrub_duration":0.0017377740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:21.902985+0000","last_change":"2023-09-28T00:16:21.902942+0000","last_active":"2023-09-28T00:16:21.902985+0000","last_peered":"2023-09-28T00:16:21.902985+0000","last_clean":"2023-09-28T00:16:21.902985+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:16:21.902985+0000","last_undegraded":"2023-09-28T00:16:21.902985+0000","last_fullsized":"2023-09-28T00:16:21.902985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:21.902835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:21.902835+0000","last_clean_scrub_stamp":"2023-09-28T00:16:21.902835+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:51.803868+0000","scrub_duration":0.001900295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230047+0000","last_change":"2023-09-28T00:15:54.304435+0000","last_active":"2023-09-28T00:16:10.230047+0000","last_peered":"2023-09-28T00:16:10.230047+0000","last_clean":"2023-09-28T00:16:10.230047+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:16:10.230047+0000","last_undegraded":"2023-09-28T00:16:10.230047+0000","last_fullsized":"2023-09-28T00:16:10.230047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:54.304310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:54.304310+0000","last_clean_scrub_stamp":"2023-09-28T00:15:54.304310+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:49:16.397435+0000","scrub_duration":0.0015026149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230677+0000","last_change":"2023-09-28T00:15:53.627491+0000","last_active":"2023-09-28T00:16:10.230677+0000","last_peered":"2023-09-28T00:16:10.230677+0000","last_clean":"2023-09-28T00:16:10.230677+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:16:10.230677+0000","last_undegraded":"2023-09-28T00:16:10.230677+0000","last_fullsized":"2023-09-28T00:16:10.230677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2023-09-28T00:15:53.627380+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2023-09-28T00:15:53.627380+0000","last_clean_scrub_stamp":"2023-09-28T00:15:53.627380+0000","objects_scrubbed":1,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:43.370335+0000","scrub_duration":0.0019854999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019557+0000","last_change":"2023-09-28T00:15:56.188990+0000","last_active":"2023-09-28T00:16:10.019557+0000","last_peered":"2023-09-28T00:16:10.019557+0000","last_clean":"2023-09-28T00:16:10.019557+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:16:10.019557+0000","last_undegraded":"2023-09-28T00:16:10.019557+0000","last_fullsized":"2023-09-28T00:16:10.019557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:56.188876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:56.188876+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.188876+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:44.486675+0000","scrub_duration":0.0016262119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230353+0000","last_change":"2023-09-28T00:15:56.746011+0000","last_active":"2023-09-28T00:16:10.230353+0000","last_peered":"2023-09-28T00:16:10.230353+0000","last_clean":"2023-09-28T00:16:10.230353+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:16:10.230353+0000","last_undegraded":"2023-09-28T00:16:10.230353+0000","last_fullsized":"2023-09-28T00:16:10.230353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-09-28T00:15:56.745896+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-09-28T00:15:56.745896+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.745896+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:14.337578+0000","scrub_duration":0.00152447,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023427+0000","last_change":"2023-09-28T00:15:50.315214+0000","last_active":"2023-09-28T00:16:10.023427+0000","last_peered":"2023-09-28T00:16:10.023427+0000","last_clean":"2023-09-28T00:16:10.023427+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:16:10.023427+0000","last_undegraded":"2023-09-28T00:16:10.023427+0000","last_fullsized":"2023-09-28T00:16:10.023427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:50.315106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:50.315106+0000","last_clean_scrub_stamp":"2023-09-28T00:15:50.315106+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:05:47.010373+0000","scrub_duration":0.0014511070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.438640+0000","last_change":"2023-09-28T00:16:11.438613+0000","last_active":"2023-09-28T00:16:11.438640+0000","last_peered":"2023-09-28T00:16:11.438640+0000","last_clean":"2023-09-28T00:16:11.438640+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:16:11.438640+0000","last_undegraded":"2023-09-28T00:16:11.438640+0000","last_fullsized":"2023-09-28T00:16:11.438640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-09-28T00:16:11.438496+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-09-28T00:16:11.438496+0000","last_clean_scrub_stamp":"2023-09-28T00:16:11.438496+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:36:15.456538+0000","scrub_duration":0.0027487670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:26.046948+0000","last_change":"2023-09-28T00:16:26.046907+0000","last_active":"2023-09-28T00:16:26.046948+0000","last_peered":"2023-09-28T00:16:26.046948+0000","last_clean":"2023-09-28T00:16:26.046948+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:16:26.046948+0000","last_undegraded":"2023-09-28T00:16:26.046948+0000","last_fullsized":"2023-09-28T00:16:26.046948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:26.046795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:26.046795+0000","last_clean_scrub_stamp":"2023-09-28T00:16:26.046795+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:21:23.170653+0000","scrub_duration":0.0017495989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022483+0000","last_change":"2023-09-28T00:16:03.483521+0000","last_active":"2023-09-28T00:16:10.022483+0000","last_peered":"2023-09-28T00:16:10.022483+0000","last_clean":"2023-09-28T00:16:10.022483+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:16:10.022483+0000","last_undegraded":"2023-09-28T00:16:10.022483+0000","last_fullsized":"2023-09-28T00:16:10.022483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2023-09-28T00:16:03.483392+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2023-09-28T00:16:03.483392+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.483392+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:51.781190+0000","scrub_duration":0.0026205619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:15.113529+0000","last_change":"2023-09-28T00:16:15.113496+0000","last_active":"2023-09-28T00:16:15.113529+0000","last_peered":"2023-09-28T00:16:15.113529+0000","last_clean":"2023-09-28T00:16:15.113529+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:16:15.113529+0000","last_undegraded":"2023-09-28T00:16:15.113529+0000","last_fullsized":"2023-09-28T00:16:15.113529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:15.113374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:15.113374+0000","last_clean_scrub_stamp":"2023-09-28T00:16:15.113374+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:18.171493+0000","scrub_duration":0.0017812539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018244+0000","last_change":"2023-09-28T00:15:59.949690+0000","last_active":"2023-09-28T00:16:10.018244+0000","last_peered":"2023-09-28T00:16:10.018244+0000","last_clean":"2023-09-28T00:16:10.018244+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:16:10.018244+0000","last_undegraded":"2023-09-28T00:16:10.018244+0000","last_fullsized":"2023-09-28T00:16:10.018244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-09-28T00:15:59.949496+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-09-28T00:15:59.949496+0000","last_clean_scrub_stamp":"2023-09-28T00:15:59.949496+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:48.247295+0000","scrub_duration":0.0018437670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017868+0000","last_change":"2023-09-28T00:15:29.384759+0000","last_active":"2023-09-28T00:16:10.017868+0000","last_peered":"2023-09-28T00:16:10.017868+0000","last_clean":"2023-09-28T00:16:10.017868+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:16:10.017868+0000","last_undegraded":"2023-09-28T00:16:10.017868+0000","last_fullsized":"2023-09-28T00:16:10.017868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230768+0000","last_change":"2023-09-28T00:16:03.661895+0000","last_active":"2023-09-28T00:16:10.230768+0000","last_peered":"2023-09-28T00:16:10.230768+0000","last_clean":"2023-09-28T00:16:10.230768+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:16:10.230768+0000","last_undegraded":"2023-09-28T00:16:10.230768+0000","last_fullsized":"2023-09-28T00:16:10.230768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2023-09-28T00:16:03.661795+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2023-09-28T00:16:03.661795+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.661795+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:03.641625+0000","scrub_duration":0.0039856939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:16.110694+0000","last_change":"2023-09-28T00:16:16.110663+0000","last_active":"2023-09-28T00:16:16.110694+0000","last_peered":"2023-09-28T00:16:16.110694+0000","last_clean":"2023-09-28T00:16:16.110694+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:16:16.110694+0000","last_undegraded":"2023-09-28T00:16:16.110694+0000","last_fullsized":"2023-09-28T00:16:16.110694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:16.110551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:16.110551+0000","last_clean_scrub_stamp":"2023-09-28T00:16:16.110551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:46.011584+0000","scrub_duration":0.001688164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.229830+0000","last_change":"2023-09-28T00:16:08.212474+0000","last_active":"2023-09-28T00:16:10.229830+0000","last_peered":"2023-09-28T00:16:10.229830+0000","last_clean":"2023-09-28T00:16:10.229830+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:16:10.229830+0000","last_undegraded":"2023-09-28T00:16:10.229830+0000","last_fullsized":"2023-09-28T00:16:10.229830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:08.212359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:08.212359+0000","last_clean_scrub_stamp":"2023-09-28T00:16:08.212359+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:25.804040+0000","scrub_duration":0.0019597149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017691+0000","last_change":"2023-09-28T00:15:29.384589+0000","last_active":"2023-09-28T00:16:10.017691+0000","last_peered":"2023-09-28T00:16:10.017691+0000","last_clean":"2023-09-28T00:16:10.017691+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:16:10.017691+0000","last_undegraded":"2023-09-28T00:16:10.017691+0000","last_fullsized":"2023-09-28T00:16:10.017691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:28.957513+0000","last_clean_scrub_stamp":"2023-09-28T00:15:28.957513+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:29.137534+0000","last_change":"2023-09-28T00:16:29.137505+0000","last_active":"2023-09-28T00:16:29.137534+0000","last_peered":"2023-09-28T00:16:29.137534+0000","last_clean":"2023-09-28T00:16:29.137534+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:16:29.137534+0000","last_undegraded":"2023-09-28T00:16:29.137534+0000","last_fullsized":"2023-09-28T00:16:29.137534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:29.137370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:29.137370+0000","last_clean_scrub_stamp":"2023-09-28T00:16:29.137370+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:42:51.396669+0000","scrub_duration":0.001534849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:16.769973+0000","last_change":"2023-09-28T00:16:16.769940+0000","last_active":"2023-09-28T00:16:16.769973+0000","last_peered":"2023-09-28T00:16:16.769973+0000","last_clean":"2023-09-28T00:16:16.769973+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:16:16.769973+0000","last_undegraded":"2023-09-28T00:16:16.769973+0000","last_fullsized":"2023-09-28T00:16:16.769973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:16.769822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:16.769822+0000","last_clean_scrub_stamp":"2023-09-28T00:16:16.769822+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:07.468808+0000","scrub_duration":0.002158989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:23.625199+0000","last_change":"2023-09-28T00:16:23.625160+0000","last_active":"2023-09-28T00:16:23.625199+0000","last_peered":"2023-09-28T00:16:23.625199+0000","last_clean":"2023-09-28T00:16:23.625199+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:16:23.625199+0000","last_undegraded":"2023-09-28T00:16:23.625199+0000","last_fullsized":"2023-09-28T00:16:23.625199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:23.625057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:23.625057+0000","last_clean_scrub_stamp":"2023-09-28T00:16:23.625057+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:26.683177+0000","scrub_duration":0.0018831360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8020,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363820,"statfs":{"total":96636764160,"available":96628551680,"internally_reserved":0,"allocated":274432,"data_stored":105828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.749}]},{"osd":2,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.77400000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.76300000000000001}]},{"osd":4,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.68200000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8092,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363748,"statfs":{"total":96636764160,"available":96628477952,"internally_reserved":0,"allocated":282624,"data_stored":106452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.58499999999999996}]},{"osd":6,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.624}]},{"osd":7,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8084,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363756,"statfs":{"total":96636764160,"available":96628486144,"internally_reserved":0,"allocated":274432,"data_stored":105828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.0860000000000003,"5min":4.0860000000000003,"15min":4.0860000000000003},"last":0.439},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.0599999999999996,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.032,"5min":4.032,"15min":4.032},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.753}]},{"osd":6,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.0019999999999998,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":0.71999999999999997}]},{"osd":7,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9180,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362660,"statfs":{"total":96636764160,"available":96627363840,"internally_reserved":0,"allocated":872448,"data_stored":696750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.6719999999999997,"5min":4.6719999999999997,"15min":4.6719999999999997},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.7800000000000002,"5min":4.7800000000000002,"15min":4.7800000000000002},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Sep 28 00:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":4.5640000000000001,"5min":4.5640000000000001,"15min":4.5640000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Thu Sep 28 00:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.2610000000000001,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.7510000000000003,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Sep 28 00:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":4.7210000000000001,"5min":4.7210000000000001,"15min":4.7210000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.2439999999999998,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":4.4400000000000004,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.6929999999999996,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":0.60299999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9204,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362636,"statfs":{"total":96636764160,"available":96627339264,"internally_reserved":0,"allocated":897024,"data_stored":697948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.505}]},{"osd":1,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.628}]},{"osd":2,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.374},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.35999999999999999}]},{"osd":5,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.41099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8020,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363820,"statfs":{"total":96636764160,"available":96628551680,"internally_reserved":0,"allocated":274432,"data_stored":105828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.435}]},{"osd":1,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":6.2990000000000004,"5min":6.2990000000000004,"15min":6.2990000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":6.2679999999999998,"5min":6.2679999999999998,"15min":6.2679999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.50600000000000001}]},{"osd":4,"last update":"Thu Sep 28 00:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":6.1509999999999998,"5min":6.1509999999999998,"15min":6.1509999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Sep 28 00:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Sep 28 00:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":6.2370000000000001,"5min":6.2370000000000001,"15min":6.2370000000000001},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":105918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.443}]},{"osd":1,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.69099999999999995}]}]},{"osd":4,"up_from":14,"seq":60129542164,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":107420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.747}]},{"osd":2,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.443}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:16:32.634 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.634 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.635 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.635 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.635 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.635 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.635 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.636 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.636 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.636 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.636 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.637 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.637 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.637 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.637 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.637 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.638 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.638 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-09-28T00:15:28.957513+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=28, tm_wday=3, tm_yday=271, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=28, tm_hour=0, tm_min=15, tm_sec=46, tm_wday=3, tm_yday=271, tm_isdst=0) 2023-09-28T00:16:32.639 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-28T00:16:52.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-28T00:16:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.774+0000 7fa74118a700 1 Processor -- start 2023-09-28T00:16:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.774+0000 7fa74118a700 1 -- start start 2023-09-28T00:16:52.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa74118a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c1562b0 0x7fa73c06e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa74118a700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa73c06e9c0 0x7fa73c0c15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa74118a700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0c1110 con 0x7fa73c156680 2023-09-28T00:16:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa74118a700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c06ee60 con 0x7fa73c06e9c0 2023-09-28T00:16:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa74118a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c06f140 con 0x7fa73c1562b0 2023-09-28T00:16:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa73b7fe700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa73c156680 0x7fa73c0ae040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35624/0 (socket says 172.21.15.26:35624) 2023-09-28T00:16:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa73b7fe700 1 -- 172.21.15.26:0/2876806614 learned_addr learned my addr 172.21.15.26:0/2876806614 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:16:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa740989700 1 --2- 172.21.15.26:0/2876806614 >> v2:172.21.15.190:3300/0 conn(0x7fa73c06e9c0 0x7fa73c0c15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa73bfff700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c1562b0 0x7fa73c06e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765027237 0 0) 0x7fa73c0c1110 con 0x7fa73c156680 2023-09-28T00:16:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.775+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa728003570 con 0x7fa73c156680 2023-09-28T00:16:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946817894 0 0) 0x7fa728003570 con 0x7fa73c156680 2023-09-28T00:16:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c1562b0 msgr2=0x7fa73c06e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c1562b0 0x7fa73c06e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 >> v2:172.21.15.190:3300/0 conn(0x7fa73c06e9c0 msgr2=0x7fa73c0c15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 --2- 172.21.15.26:0/2876806614 >> v2:172.21.15.190:3300/0 conn(0x7fa73c06e9c0 0x7fa73c0c15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c06f420 con 0x7fa73c156680 2023-09-28T00:16:52.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fa724001470 con 0x7fa73c156680 2023-09-28T00:16:52.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 >> v1:172.21.15.26:6789/0 conn(0x7fa73c156680 legacy=0x7fa73c0ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:52.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728003a60 0x7fa728003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:52.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa728004810 0x7fa728004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:52.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c1562b0 0x7fa7280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:52.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c06ee60 con 0x7fa728004810 2023-09-28T00:16:52.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c06f140 con 0x7fa728003a60 2023-09-28T00:16:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72800ba60 con 0x7fa73c1562b0 2023-09-28T00:16:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73b7fe700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa728004810 0x7fa728004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73bfff700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728003a60 0x7fa728003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa740989700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c1562b0 0x7fa7280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73b7fe700 1 -- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c1562b0 msgr2=0x7fa7280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73b7fe700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c1562b0 0x7fa7280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73b7fe700 1 -- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728003a60 msgr2=0x7fa728003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73b7fe700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728003a60 0x7fa728003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73b7fe700 1 -- 172.21.15.26:0/2876806614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728003570 con 0x7fa728004810 2023-09-28T00:16:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73b7fe700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa728004810 0x7fa728004c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa72400c3f0 tx=0x7fa73c0c1080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf005b5584da8c09 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.776+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72400cc80 con 0x7fa728004810 2023-09-28T00:16:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.777+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72400ce20 con 0x7fa728004810 2023-09-28T00:16:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.777+0000 7fa73affd700 1 -- 172.21.15.26:0/2876806614 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724005b70 con 0x7fa728004810 2023-09-28T00:16:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.777+0000 7fa74118a700 1 -- 172.21.15.26:0/2876806614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa728004810 msgr2=0x7fa728004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.777+0000 7fa74118a700 1 --2- 172.21.15.26:0/2876806614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa728004810 0x7fa728004c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa72400c3f0 tx=0x7fa73c0c1080 comp rx=0 tx=0).stop 2023-09-28T00:16:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.777+0000 7fa740989700 1 -- 172.21.15.26:0/2876806614 reap_dead start 2023-09-28T00:16:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.777+0000 7fa74118a700 1 -- 172.21.15.26:0/2876806614 shutdown_connections 2023-09-28T00:16:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.777+0000 7fa74118a700 1 -- 172.21.15.26:0/2876806614 >> 172.21.15.26:0/2876806614 conn(0x7fa73c0c95d0 msgr2=0x7fa73c067630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.777+0000 7fa74118a700 1 -- 172.21.15.26:0/2876806614 shutdown_connections 2023-09-28T00:16:52.784 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.777+0000 7fa74118a700 1 -- 172.21.15.26:0/2876806614 wait complete. 2023-09-28T00:16:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.778+0000 7fa74118a700 1 Processor -- start 2023-09-28T00:16:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.778+0000 7fa74118a700 1 -- start start 2023-09-28T00:16:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa74118a700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728004810 0x7fa73c14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa74118a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c1540b0 0x7fa73c0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa74118a700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c151320 0x7fa73c151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa74118a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c151cb0 con 0x7fa73c1540b0 2023-09-28T00:16:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa74118a700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0b0e30 con 0x7fa728004810 2023-09-28T00:16:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa74118a700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0b1110 con 0x7fa73c151320 2023-09-28T00:16:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa73b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c1540b0 0x7fa73c0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa73b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c1540b0 0x7fa73c0b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42314/0 (socket says 172.21.15.26:42314) 2023-09-28T00:16:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa73b7fe700 1 -- 172.21.15.26:0/2831088044 learned_addr learned my addr 172.21.15.26:0/2831088044 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa740989700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c151320 0x7fa73c151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.779+0000 7fa73bfff700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728004810 0x7fa73c14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa73b7fe700 1 -- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c151320 msgr2=0x7fa73c151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa73b7fe700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c151320 0x7fa73c151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa73b7fe700 1 -- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728004810 msgr2=0x7fa73c14f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa73b7fe700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728004810 0x7fa73c14f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa73b7fe700 1 -- 172.21.15.26:0/2831088044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0b13f0 con 0x7fa73c1540b0 2023-09-28T00:16:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa73bfff700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728004810 0x7fa73c14f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:16:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa73b7fe700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c1540b0 0x7fa73c0b0590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa7280046d0 tx=0x7fa724015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa733fff700 1 -- 172.21.15.26:0/2831088044 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72400cc80 con 0x7fa73c1540b0 2023-09-28T00:16:52.789 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa733fff700 1 -- 172.21.15.26:0/2831088044 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7240072e0 con 0x7fa73c1540b0 2023-09-28T00:16:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c0b16d0 con 0x7fa73c1540b0 2023-09-28T00:16:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa733fff700 1 -- 172.21.15.26:0/2831088044 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724007680 con 0x7fa73c1540b0 2023-09-28T00:16:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.780+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c0b1a40 con 0x7fa73c1540b0 2023-09-28T00:16:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.781+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c1555f0 con 0x7fa73c1540b0 2023-09-28T00:16:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.781+0000 7fa733fff700 1 -- 172.21.15.26:0/2831088044 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fa724019070 con 0x7fa73c1540b0 2023-09-28T00:16:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.782+0000 7fa733fff700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa71c067330 0x7fa71c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.782+0000 7fa733fff700 1 -- 172.21.15.26:0/2831088044 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa724085b60 con 0x7fa73c1540b0 2023-09-28T00:16:52.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.782+0000 7fa73bfff700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa71c067330 0x7fa71c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.782+0000 7fa73bfff700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa71c067330 0x7fa71c0697e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa72c006dc0 tx=0x7fa72c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.786+0000 7fa733fff700 1 -- 172.21.15.26:0/2831088044 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fa724052a20 con 0x7fa73c1540b0 2023-09-28T00:16:52.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.975+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 --> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa73c04c3c0 con 0x7fa71c067330 2023-09-28T00:16:52.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.984+0000 7fa733fff700 1 -- 172.21.15.26:0/2831088044 <== mgr.4102 v2:172.21.15.190:6832/89869 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310939 (secure 0 0 0) 0x7fa73c04c3c0 con 0x7fa71c067330 2023-09-28T00:16:52.988 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:16:52.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa71c067330 msgr2=0x7fa71c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:52.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa71c067330 0x7fa71c0697e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa72c006dc0 tx=0x7fa72c008040 comp rx=0 tx=0).stop 2023-09-28T00:16:52.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c1540b0 msgr2=0x7fa73c0b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:52.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c1540b0 0x7fa73c0b0590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa7280046d0 tx=0x7fa724015000 comp rx=0 tx=0).stop 2023-09-28T00:16:52.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 shutdown_connections 2023-09-28T00:16:52.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fa71c067330 0x7fa71c0697e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa73c151320 0x7fa73c151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728004810 0x7fa73c14f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 --2- 172.21.15.26:0/2831088044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa73c1540b0 0x7fa73c0b0590 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:52.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 >> 172.21.15.26:0/2831088044 conn(0x7fa73c0c95d0 msgr2=0x7fa73c06af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:52.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 shutdown_connections 2023-09-28T00:16:52.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:52.987+0000 7fa74118a700 1 -- 172.21.15.26:0/2831088044 wait complete. 2023-09-28T00:16:52.993 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-09-28T00:16:53.000 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2023-09-28T00:16:51.688560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67048,"kb_used_data":3368,"kb_used_omap":0,"kb_used_meta":63616,"kb_avail":754907672,"statfs":{"total":773094113280,"available":773025456128,"internally_reserved":0,"allocated":3448832,"data_stored":2031972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65142784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003405"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023608+0000","last_change":"2023-09-28T00:15:56.267872+0000","last_active":"2023-09-28T00:16:10.023608+0000","last_peered":"2023-09-28T00:16:10.023608+0000","last_clean":"2023-09-28T00:16:10.023608+0000","last_became_active":"2023-09-28T00:15:29.391834+0000","last_became_peered":"2023-09-28T00:15:29.391834+0000","last_unstale":"2023-09-28T00:16:10.023608+0000","last_undegraded":"2023-09-28T00:16:10.023608+0000","last_fullsized":"2023-09-28T00:16:10.023608+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:56.267743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:56.267743+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.267743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:45.165125+0000","scrub_duration":0.0017700940000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:32.437292+0000","last_change":"2023-09-28T00:16:32.437265+0000","last_active":"2023-09-28T00:16:32.437292+0000","last_peered":"2023-09-28T00:16:32.437292+0000","last_clean":"2023-09-28T00:16:32.437292+0000","last_became_active":"2023-09-28T00:15:29.385075+0000","last_became_peered":"2023-09-28T00:15:29.385075+0000","last_unstale":"2023-09-28T00:16:32.437292+0000","last_undegraded":"2023-09-28T00:16:32.437292+0000","last_fullsized":"2023-09-28T00:16:32.437292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:32.437135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:32.437135+0000","last_clean_scrub_stamp":"2023-09-28T00:16:32.437135+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:21:29.560993+0000","scrub_duration":0.0015085470000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:39.205554+0000","last_change":"2023-09-28T00:16:39.205524+0000","last_active":"2023-09-28T00:16:39.205554+0000","last_peered":"2023-09-28T00:16:39.205554+0000","last_clean":"2023-09-28T00:16:39.205554+0000","last_became_active":"2023-09-28T00:15:29.402480+0000","last_became_peered":"2023-09-28T00:15:29.402480+0000","last_unstale":"2023-09-28T00:16:39.205554+0000","last_undegraded":"2023-09-28T00:16:39.205554+0000","last_fullsized":"2023-09-28T00:16:39.205554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:39.205416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:39.205416+0000","last_clean_scrub_stamp":"2023-09-28T00:16:39.205416+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:57:14.095286+0000","scrub_duration":0.001980239,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:16.155834+0000","last_change":"2023-09-28T00:16:16.155775+0000","last_active":"2023-09-28T00:16:16.155834+0000","last_peered":"2023-09-28T00:16:16.155834+0000","last_clean":"2023-09-28T00:16:16.155834+0000","last_became_active":"2023-09-28T00:15:29.387051+0000","last_became_peered":"2023-09-28T00:15:29.387051+0000","last_unstale":"2023-09-28T00:16:16.155834+0000","last_undegraded":"2023-09-28T00:16:16.155834+0000","last_fullsized":"2023-09-28T00:16:16.155834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:16.155665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:16.155665+0000","last_clean_scrub_stamp":"2023-09-28T00:16:16.155665+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:16.135495+0000","scrub_duration":0.0019898139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:34.327860+0000","last_change":"2023-09-28T00:16:34.327816+0000","last_active":"2023-09-28T00:16:34.327860+0000","last_peered":"2023-09-28T00:16:34.327860+0000","last_clean":"2023-09-28T00:16:34.327860+0000","last_became_active":"2023-09-28T00:15:29.396181+0000","last_became_peered":"2023-09-28T00:15:29.396181+0000","last_unstale":"2023-09-28T00:16:34.327860+0000","last_undegraded":"2023-09-28T00:16:34.327860+0000","last_fullsized":"2023-09-28T00:16:34.327860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:34.327691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:34.327691+0000","last_clean_scrub_stamp":"2023-09-28T00:16:34.327691+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:42:56.586990+0000","scrub_duration":0.001786387,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:41.179496+0000","last_change":"2023-09-28T00:16:41.179469+0000","last_active":"2023-09-28T00:16:41.179496+0000","last_peered":"2023-09-28T00:16:41.179496+0000","last_clean":"2023-09-28T00:16:41.179496+0000","last_became_active":"2023-09-28T00:15:29.397054+0000","last_became_peered":"2023-09-28T00:15:29.397054+0000","last_unstale":"2023-09-28T00:16:41.179496+0000","last_undegraded":"2023-09-28T00:16:41.179496+0000","last_fullsized":"2023-09-28T00:16:41.179496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:41.179344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:41.179344+0000","last_clean_scrub_stamp":"2023-09-28T00:16:41.179344+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:39:43.967632+0000","scrub_duration":0.0022134989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:35.066434+0000","last_change":"2023-09-28T00:16:35.066393+0000","last_active":"2023-09-28T00:16:35.066434+0000","last_peered":"2023-09-28T00:16:35.066434+0000","last_clean":"2023-09-28T00:16:35.066434+0000","last_became_active":"2023-09-28T00:15:29.385946+0000","last_became_peered":"2023-09-28T00:15:29.385946+0000","last_unstale":"2023-09-28T00:16:35.066434+0000","last_undegraded":"2023-09-28T00:16:35.066434+0000","last_fullsized":"2023-09-28T00:16:35.066434+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:35.066290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:35.066290+0000","last_clean_scrub_stamp":"2023-09-28T00:16:35.066290+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:21:32.190148+0000","scrub_duration":0.0018632449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:27.358682+0000","last_change":"2023-09-28T00:16:27.358654+0000","last_active":"2023-09-28T00:16:27.358682+0000","last_peered":"2023-09-28T00:16:27.358682+0000","last_clean":"2023-09-28T00:16:27.358682+0000","last_became_active":"2023-09-28T00:15:29.398417+0000","last_became_peered":"2023-09-28T00:15:29.398417+0000","last_unstale":"2023-09-28T00:16:27.358682+0000","last_undegraded":"2023-09-28T00:16:27.358682+0000","last_fullsized":"2023-09-28T00:16:27.358682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:27.358538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:27.358538+0000","last_clean_scrub_stamp":"2023-09-28T00:16:27.358538+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:53:12.417572+0000","scrub_duration":0.0015811180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:28.396094+0000","last_change":"2023-09-28T00:16:28.396056+0000","last_active":"2023-09-28T00:16:28.396094+0000","last_peered":"2023-09-28T00:16:28.396094+0000","last_clean":"2023-09-28T00:16:28.396094+0000","last_became_active":"2023-09-28T00:15:29.400592+0000","last_became_peered":"2023-09-28T00:15:29.400592+0000","last_unstale":"2023-09-28T00:16:28.396094+0000","last_undegraded":"2023-09-28T00:16:28.396094+0000","last_fullsized":"2023-09-28T00:16:28.396094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:28.395934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:28.395934+0000","last_clean_scrub_stamp":"2023-09-28T00:16:28.395934+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:38:53.750131+0000","scrub_duration":0.0016835039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:17.377251+0000","last_change":"2023-09-28T00:16:17.377212+0000","last_active":"2023-09-28T00:16:17.377251+0000","last_peered":"2023-09-28T00:16:17.377251+0000","last_clean":"2023-09-28T00:16:17.377251+0000","last_became_active":"2023-09-28T00:15:29.387959+0000","last_became_peered":"2023-09-28T00:15:29.387959+0000","last_unstale":"2023-09-28T00:16:17.377251+0000","last_undegraded":"2023-09-28T00:16:17.377251+0000","last_fullsized":"2023-09-28T00:16:17.377251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:17.377100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:17.377100+0000","last_clean_scrub_stamp":"2023-09-28T00:16:17.377100+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:08.076087+0000","scrub_duration":0.0021518069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:32.162930+0000","last_change":"2023-09-28T00:16:32.162899+0000","last_active":"2023-09-28T00:16:32.162930+0000","last_peered":"2023-09-28T00:16:32.162930+0000","last_clean":"2023-09-28T00:16:32.162930+0000","last_became_active":"2023-09-28T00:15:29.395152+0000","last_became_peered":"2023-09-28T00:15:29.395152+0000","last_unstale":"2023-09-28T00:16:32.162930+0000","last_undegraded":"2023-09-28T00:16:32.162930+0000","last_fullsized":"2023-09-28T00:16:32.162930+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:32.162783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:32.162783+0000","last_clean_scrub_stamp":"2023-09-28T00:16:32.162783+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:30:37.741378+0000","scrub_duration":0.0021579009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023347+0000","last_change":"2023-09-28T00:15:54.316536+0000","last_active":"2023-09-28T00:16:10.023347+0000","last_peered":"2023-09-28T00:16:10.023347+0000","last_clean":"2023-09-28T00:16:10.023347+0000","last_became_active":"2023-09-28T00:15:29.398990+0000","last_became_peered":"2023-09-28T00:15:29.398990+0000","last_unstale":"2023-09-28T00:16:10.023347+0000","last_undegraded":"2023-09-28T00:16:10.023347+0000","last_fullsized":"2023-09-28T00:16:10.023347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:54.316397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:54.316397+0000","last_clean_scrub_stamp":"2023-09-28T00:15:54.316397+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:49:16.409521+0000","scrub_duration":0.002011128,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023323+0000","last_change":"2023-09-28T00:15:51.344205+0000","last_active":"2023-09-28T00:16:10.023323+0000","last_peered":"2023-09-28T00:16:10.023323+0000","last_clean":"2023-09-28T00:16:10.023323+0000","last_became_active":"2023-09-28T00:15:29.391803+0000","last_became_peered":"2023-09-28T00:15:29.391803+0000","last_unstale":"2023-09-28T00:16:10.023323+0000","last_undegraded":"2023-09-28T00:16:10.023323+0000","last_fullsized":"2023-09-28T00:16:10.023323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:51.344105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:51.344105+0000","last_clean_scrub_stamp":"2023-09-28T00:15:51.344105+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:48:59.963637+0000","scrub_duration":0.001439826,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:22.296538+0000","last_change":"2023-09-28T00:16:22.296509+0000","last_active":"2023-09-28T00:16:22.296538+0000","last_peered":"2023-09-28T00:16:22.296538+0000","last_clean":"2023-09-28T00:16:22.296538+0000","last_became_active":"2023-09-28T00:15:29.393841+0000","last_became_peered":"2023-09-28T00:15:29.393841+0000","last_unstale":"2023-09-28T00:16:22.296538+0000","last_undegraded":"2023-09-28T00:16:22.296538+0000","last_fullsized":"2023-09-28T00:16:22.296538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:22.296381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:22.296381+0000","last_clean_scrub_stamp":"2023-09-28T00:16:22.296381+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:52.197414+0000","scrub_duration":0.0020376249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:30.990175+0000","last_change":"2023-09-28T00:16:30.990146+0000","last_active":"2023-09-28T00:16:30.990175+0000","last_peered":"2023-09-28T00:16:30.990175+0000","last_clean":"2023-09-28T00:16:30.990175+0000","last_became_active":"2023-09-28T00:15:29.390941+0000","last_became_peered":"2023-09-28T00:15:29.390941+0000","last_unstale":"2023-09-28T00:16:30.990175+0000","last_undegraded":"2023-09-28T00:16:30.990175+0000","last_fullsized":"2023-09-28T00:16:30.990175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:30.990035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:30.990035+0000","last_clean_scrub_stamp":"2023-09-28T00:16:30.990035+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:53:16.049069+0000","scrub_duration":0.002032612,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019882+0000","last_change":"2023-09-28T00:15:58.202941+0000","last_active":"2023-09-28T00:16:10.019882+0000","last_peered":"2023-09-28T00:16:10.019882+0000","last_clean":"2023-09-28T00:16:10.019882+0000","last_became_active":"2023-09-28T00:15:29.396936+0000","last_became_peered":"2023-09-28T00:15:29.396936+0000","last_unstale":"2023-09-28T00:16:10.019882+0000","last_undegraded":"2023-09-28T00:16:10.019882+0000","last_fullsized":"2023-09-28T00:16:10.019882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:58.202825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:58.202825+0000","last_clean_scrub_stamp":"2023-09-28T00:15:58.202825+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:05:02.833041+0000","scrub_duration":0.0020265230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:17.528662+0000","last_change":"2023-09-28T00:16:17.528631+0000","last_active":"2023-09-28T00:16:17.528662+0000","last_peered":"2023-09-28T00:16:17.528662+0000","last_clean":"2023-09-28T00:16:17.528662+0000","last_became_active":"2023-09-28T00:15:29.400918+0000","last_became_peered":"2023-09-28T00:15:29.400918+0000","last_unstale":"2023-09-28T00:16:17.528662+0000","last_undegraded":"2023-09-28T00:16:17.528662+0000","last_fullsized":"2023-09-28T00:16:17.528662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:17.528525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:17.528525+0000","last_clean_scrub_stamp":"2023-09-28T00:16:17.528525+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:15:56.525290+0000","scrub_duration":0.0014540270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:34.191937+0000","last_change":"2023-09-28T00:16:34.191907+0000","last_active":"2023-09-28T00:16:34.191937+0000","last_peered":"2023-09-28T00:16:34.191937+0000","last_clean":"2023-09-28T00:16:34.191937+0000","last_became_active":"2023-09-28T00:15:29.398104+0000","last_became_peered":"2023-09-28T00:15:29.398104+0000","last_unstale":"2023-09-28T00:16:34.191937+0000","last_undegraded":"2023-09-28T00:16:34.191937+0000","last_fullsized":"2023-09-28T00:16:34.191937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:34.191802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:34.191802+0000","last_clean_scrub_stamp":"2023-09-28T00:16:34.191802+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T10:35:33.460058+0000","scrub_duration":0.0019839609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023480+0000","last_change":"2023-09-28T00:15:52.314313+0000","last_active":"2023-09-28T00:16:10.023480+0000","last_peered":"2023-09-28T00:16:10.023480+0000","last_clean":"2023-09-28T00:16:10.023480+0000","last_became_active":"2023-09-28T00:15:29.385950+0000","last_became_peered":"2023-09-28T00:15:29.385950+0000","last_unstale":"2023-09-28T00:16:10.023480+0000","last_undegraded":"2023-09-28T00:16:10.023480+0000","last_fullsized":"2023-09-28T00:16:10.023480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:52.314217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:52.314217+0000","last_clean_scrub_stamp":"2023-09-28T00:15:52.314217+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:22:43.890895+0000","scrub_duration":0.0018513100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:38.218161+0000","last_change":"2023-09-28T00:16:38.218132+0000","last_active":"2023-09-28T00:16:38.218161+0000","last_peered":"2023-09-28T00:16:38.218161+0000","last_clean":"2023-09-28T00:16:38.218161+0000","last_became_active":"2023-09-28T00:15:29.398872+0000","last_became_peered":"2023-09-28T00:15:29.398872+0000","last_unstale":"2023-09-28T00:16:38.218161+0000","last_undegraded":"2023-09-28T00:16:38.218161+0000","last_fullsized":"2023-09-28T00:16:38.218161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:38.218011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:38.218011+0000","last_clean_scrub_stamp":"2023-09-28T00:16:38.218011+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:18:31.124347+0000","scrub_duration":0.001505766,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:25.911413+0000","last_change":"2023-09-28T00:16:25.911380+0000","last_active":"2023-09-28T00:16:25.911413+0000","last_peered":"2023-09-28T00:16:25.911413+0000","last_clean":"2023-09-28T00:16:25.911413+0000","last_became_active":"2023-09-28T00:16:11.427127+0000","last_became_peered":"2023-09-28T00:16:11.427127+0000","last_unstale":"2023-09-28T00:16:25.911413+0000","last_undegraded":"2023-09-28T00:16:25.911413+0000","last_fullsized":"2023-09-28T00:16:25.911413+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:25.911277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:25.911277+0000","last_clean_scrub_stamp":"2023-09-28T00:16:25.911277+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:55.812310+0000","scrub_duration":0.0017471279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230272+0000","last_change":"2023-09-28T00:16:04.657359+0000","last_active":"2023-09-28T00:16:10.230272+0000","last_peered":"2023-09-28T00:16:10.230272+0000","last_clean":"2023-09-28T00:16:10.230272+0000","last_became_active":"2023-09-28T00:15:29.393959+0000","last_became_peered":"2023-09-28T00:15:29.393959+0000","last_unstale":"2023-09-28T00:16:10.230272+0000","last_undegraded":"2023-09-28T00:16:10.230272+0000","last_fullsized":"2023-09-28T00:16:10.230272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:04.657222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:04.657222+0000","last_clean_scrub_stamp":"2023-09-28T00:16:04.657222+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:31.711975+0000","scrub_duration":0.0016007720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017990+0000","last_change":"2023-09-28T00:16:04.886920+0000","last_active":"2023-09-28T00:16:10.017990+0000","last_peered":"2023-09-28T00:16:10.017990+0000","last_clean":"2023-09-28T00:16:10.017990+0000","last_became_active":"2023-09-28T00:15:29.387574+0000","last_became_peered":"2023-09-28T00:15:29.387574+0000","last_unstale":"2023-09-28T00:16:10.017990+0000","last_undegraded":"2023-09-28T00:16:10.017990+0000","last_fullsized":"2023-09-28T00:16:10.017990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:04.886808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:04.886808+0000","last_clean_scrub_stamp":"2023-09-28T00:16:04.886808+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:04.866638+0000","scrub_duration":0.001535238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:33.053266+0000","last_change":"2023-09-28T00:16:33.053228+0000","last_active":"2023-09-28T00:16:33.053266+0000","last_peered":"2023-09-28T00:16:33.053266+0000","last_clean":"2023-09-28T00:16:33.053266+0000","last_became_active":"2023-09-28T00:15:29.392043+0000","last_became_peered":"2023-09-28T00:15:29.392043+0000","last_unstale":"2023-09-28T00:16:33.053266+0000","last_undegraded":"2023-09-28T00:16:33.053266+0000","last_fullsized":"2023-09-28T00:16:33.053266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:33.053116+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:33.053116+0000","last_clean_scrub_stamp":"2023-09-28T00:16:33.053116+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:38:58.407313+0000","scrub_duration":0.001813336,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:21.647104+0000","last_change":"2023-09-28T00:16:21.647070+0000","last_active":"2023-09-28T00:16:21.647104+0000","last_peered":"2023-09-28T00:16:21.647104+0000","last_clean":"2023-09-28T00:16:21.647104+0000","last_became_active":"2023-09-28T00:15:29.392027+0000","last_became_peered":"2023-09-28T00:15:29.392027+0000","last_unstale":"2023-09-28T00:16:21.647104+0000","last_undegraded":"2023-09-28T00:16:21.647104+0000","last_fullsized":"2023-09-28T00:16:21.647104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:21.646960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:21.646960+0000","last_clean_scrub_stamp":"2023-09-28T00:16:21.646960+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:16:00.643725+0000","scrub_duration":0.0021571820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025140+0000","last_change":"2023-09-28T00:16:03.620852+0000","last_active":"2023-09-28T00:16:10.025140+0000","last_peered":"2023-09-28T00:16:10.025140+0000","last_clean":"2023-09-28T00:16:10.025140+0000","last_became_active":"2023-09-28T00:15:29.384602+0000","last_became_peered":"2023-09-28T00:15:29.384602+0000","last_unstale":"2023-09-28T00:16:10.025140+0000","last_undegraded":"2023-09-28T00:16:10.025140+0000","last_fullsized":"2023-09-28T00:16:10.025140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:03.620725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:03.620725+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.620725+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:51.918523+0000","scrub_duration":0.0017002300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:35.432225+0000","last_change":"2023-09-28T00:16:35.432195+0000","last_active":"2023-09-28T00:16:35.432225+0000","last_peered":"2023-09-28T00:16:35.432225+0000","last_clean":"2023-09-28T00:16:35.432225+0000","last_became_active":"2023-09-28T00:15:29.395845+0000","last_became_peered":"2023-09-28T00:15:29.395845+0000","last_unstale":"2023-09-28T00:16:35.432225+0000","last_undegraded":"2023-09-28T00:16:35.432225+0000","last_fullsized":"2023-09-28T00:16:35.432225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:35.432091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:35.432091+0000","last_clean_scrub_stamp":"2023-09-28T00:16:35.432091+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:42:57.691390+0000","scrub_duration":0.0014386379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.141337+0000","last_change":"2023-09-28T00:16:11.141295+0000","last_active":"2023-09-28T00:16:11.141337+0000","last_peered":"2023-09-28T00:16:11.141337+0000","last_clean":"2023-09-28T00:16:11.141337+0000","last_became_active":"2023-09-28T00:15:28.982637+0000","last_became_peered":"2023-09-28T00:15:28.982637+0000","last_unstale":"2023-09-28T00:16:11.141337+0000","last_undegraded":"2023-09-28T00:16:11.141337+0000","last_fullsized":"2023-09-28T00:16:11.141337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-09-28T00:16:11.141186+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-09-28T00:16:11.141186+0000","last_clean_scrub_stamp":"2023-09-28T00:16:11.141186+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:01.840172+0000","scrub_duration":0.001800669,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018485+0000","last_change":"2023-09-28T00:16:01.926267+0000","last_active":"2023-09-28T00:16:10.018485+0000","last_peered":"2023-09-28T00:16:10.018485+0000","last_clean":"2023-09-28T00:16:10.018485+0000","last_became_active":"2023-09-28T00:15:29.383141+0000","last_became_peered":"2023-09-28T00:15:29.383141+0000","last_unstale":"2023-09-28T00:16:10.018485+0000","last_undegraded":"2023-09-28T00:16:10.018485+0000","last_fullsized":"2023-09-28T00:16:10.018485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:01.926150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:01.926150+0000","last_clean_scrub_stamp":"2023-09-28T00:16:01.926150+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:12:25.987525+0000","scrub_duration":0.0015574779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.024727+0000","last_change":"2023-09-28T00:15:55.616876+0000","last_active":"2023-09-28T00:16:10.024727+0000","last_peered":"2023-09-28T00:16:10.024727+0000","last_clean":"2023-09-28T00:16:10.024727+0000","last_became_active":"2023-09-28T00:15:28.984023+0000","last_became_peered":"2023-09-28T00:15:28.984023+0000","last_unstale":"2023-09-28T00:16:10.024727+0000","last_undegraded":"2023-09-28T00:16:10.024727+0000","last_fullsized":"2023-09-28T00:16:10.024727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:55.616759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:55.616759+0000","last_clean_scrub_stamp":"2023-09-28T00:15:55.616759+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:32:29.805704+0000","scrub_duration":0.00169892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:31.381276+0000","last_change":"2023-09-28T00:16:31.381229+0000","last_active":"2023-09-28T00:16:31.381276+0000","last_peered":"2023-09-28T00:16:31.381276+0000","last_clean":"2023-09-28T00:16:31.381276+0000","last_became_active":"2023-09-28T00:15:29.398567+0000","last_became_peered":"2023-09-28T00:15:29.398567+0000","last_unstale":"2023-09-28T00:16:31.381276+0000","last_undegraded":"2023-09-28T00:16:31.381276+0000","last_fullsized":"2023-09-28T00:16:31.381276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:31.381117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:31.381117+0000","last_clean_scrub_stamp":"2023-09-28T00:16:31.381117+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:21:28.504974+0000","scrub_duration":0.001783427,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017777+0000","last_change":"2023-09-28T00:15:56.876590+0000","last_active":"2023-09-28T00:16:10.017777+0000","last_peered":"2023-09-28T00:16:10.017777+0000","last_clean":"2023-09-28T00:16:10.017777+0000","last_became_active":"2023-09-28T00:15:28.984611+0000","last_became_peered":"2023-09-28T00:15:28.984611+0000","last_unstale":"2023-09-28T00:16:10.017777+0000","last_undegraded":"2023-09-28T00:16:10.017777+0000","last_fullsized":"2023-09-28T00:16:10.017777+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:56.876455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:56.876455+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.876455+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:14.468136+0000","scrub_duration":0.0015522699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230125+0000","last_change":"2023-09-28T00:16:05.256890+0000","last_active":"2023-09-28T00:16:10.230125+0000","last_peered":"2023-09-28T00:16:10.230125+0000","last_clean":"2023-09-28T00:16:10.230125+0000","last_became_active":"2023-09-28T00:15:29.390894+0000","last_became_peered":"2023-09-28T00:15:29.390894+0000","last_unstale":"2023-09-28T00:16:10.230125+0000","last_undegraded":"2023-09-28T00:16:10.230125+0000","last_fullsized":"2023-09-28T00:16:10.230125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.256766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.256766+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.256766+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:54.999721+0000","scrub_duration":0.0015163100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230765+0000","last_change":"2023-09-28T00:15:59.709473+0000","last_active":"2023-09-28T00:16:10.230765+0000","last_peered":"2023-09-28T00:16:10.230765+0000","last_clean":"2023-09-28T00:16:10.230765+0000","last_became_active":"2023-09-28T00:15:28.990224+0000","last_became_peered":"2023-09-28T00:15:28.990224+0000","last_unstale":"2023-09-28T00:16:10.230765+0000","last_undegraded":"2023-09-28T00:16:10.230765+0000","last_fullsized":"2023-09-28T00:16:10.230765+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:59.709361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:59.709361+0000","last_clean_scrub_stamp":"2023-09-28T00:15:59.709361+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:48.007160+0000","scrub_duration":0.0020169540000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017768+0000","last_change":"2023-09-28T00:16:05.850253+0000","last_active":"2023-09-28T00:16:10.017768+0000","last_peered":"2023-09-28T00:16:10.017768+0000","last_clean":"2023-09-28T00:16:10.017768+0000","last_became_active":"2023-09-28T00:15:29.380752+0000","last_became_peered":"2023-09-28T00:15:29.380752+0000","last_unstale":"2023-09-28T00:16:10.017768+0000","last_undegraded":"2023-09-28T00:16:10.017768+0000","last_fullsized":"2023-09-28T00:16:10.017768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.850133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.850133+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.850133+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:32.904885+0000","scrub_duration":0.00147853,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022513+0000","last_change":"2023-09-28T00:16:09.443171+0000","last_active":"2023-09-28T00:16:10.022513+0000","last_peered":"2023-09-28T00:16:10.022513+0000","last_clean":"2023-09-28T00:16:10.022513+0000","last_became_active":"2023-09-28T00:15:28.988750+0000","last_became_peered":"2023-09-28T00:15:28.988750+0000","last_unstale":"2023-09-28T00:16:10.022513+0000","last_undegraded":"2023-09-28T00:16:10.022513+0000","last_fullsized":"2023-09-28T00:16:10.022513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:09.443032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:09.443032+0000","last_clean_scrub_stamp":"2023-09-28T00:16:09.443032+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:36.497785+0000","scrub_duration":0.00158618,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:30.013396+0000","last_change":"2023-09-28T00:16:30.013344+0000","last_active":"2023-09-28T00:16:30.013396+0000","last_peered":"2023-09-28T00:16:30.013396+0000","last_clean":"2023-09-28T00:16:30.013396+0000","last_became_active":"2023-09-28T00:15:29.388563+0000","last_became_peered":"2023-09-28T00:15:29.388563+0000","last_unstale":"2023-09-28T00:16:30.013396+0000","last_undegraded":"2023-09-28T00:16:30.013396+0000","last_fullsized":"2023-09-28T00:16:30.013396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:30.013228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:30.013228+0000","last_clean_scrub_stamp":"2023-09-28T00:16:30.013228+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:38:55.367425+0000","scrub_duration":0.0019172130000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"26'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:23.875142+0000","last_change":"2023-09-28T00:16:23.875097+0000","last_active":"2023-09-28T00:16:23.875142+0000","last_peered":"2023-09-28T00:16:23.875142+0000","last_clean":"2023-09-28T00:16:23.875142+0000","last_became_active":"2023-09-28T00:15:28.981073+0000","last_became_peered":"2023-09-28T00:15:28.981073+0000","last_unstale":"2023-09-28T00:16:23.875142+0000","last_undegraded":"2023-09-28T00:16:23.875142+0000","last_fullsized":"2023-09-28T00:16:23.875142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'5","last_scrub_stamp":"2023-09-28T00:16:23.874994+0000","last_deep_scrub":"26'5","last_deep_scrub_stamp":"2023-09-28T00:16:23.874994+0000","last_clean_scrub_stamp":"2023-09-28T00:16:23.874994+0000","objects_scrubbed":2,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:16:02.871759+0000","scrub_duration":0.0041905149999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:24.645540+0000","last_change":"2023-09-28T00:16:24.645486+0000","last_active":"2023-09-28T00:16:24.645540+0000","last_peered":"2023-09-28T00:16:24.645540+0000","last_clean":"2023-09-28T00:16:24.645540+0000","last_became_active":"2023-09-28T00:15:29.389327+0000","last_became_peered":"2023-09-28T00:15:29.389327+0000","last_unstale":"2023-09-28T00:16:24.645540+0000","last_undegraded":"2023-09-28T00:16:24.645540+0000","last_fullsized":"2023-09-28T00:16:24.645540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:24.645361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:24.645361+0000","last_clean_scrub_stamp":"2023-09-28T00:16:24.645361+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:54.546394+0000","scrub_duration":0.002349795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'10","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:13.095052+0000","last_change":"2023-09-28T00:16:13.095001+0000","last_active":"2023-09-28T00:16:13.095052+0000","last_peered":"2023-09-28T00:16:13.095052+0000","last_clean":"2023-09-28T00:16:13.095052+0000","last_became_active":"2023-09-28T00:15:28.978798+0000","last_became_peered":"2023-09-28T00:15:28.978798+0000","last_unstale":"2023-09-28T00:16:13.095052+0000","last_undegraded":"2023-09-28T00:16:13.095052+0000","last_fullsized":"2023-09-28T00:16:13.095052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'10","last_scrub_stamp":"2023-09-28T00:16:13.094891+0000","last_deep_scrub":"26'10","last_deep_scrub_stamp":"2023-09-28T00:16:13.094891+0000","last_clean_scrub_stamp":"2023-09-28T00:16:13.094891+0000","objects_scrubbed":4,"log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:15:52.091656+0000","scrub_duration":0.0068571760000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:33.164225+0000","last_change":"2023-09-28T00:16:33.164199+0000","last_active":"2023-09-28T00:16:33.164225+0000","last_peered":"2023-09-28T00:16:33.164225+0000","last_clean":"2023-09-28T00:16:33.164225+0000","last_became_active":"2023-09-28T00:15:29.398346+0000","last_became_peered":"2023-09-28T00:15:29.398346+0000","last_unstale":"2023-09-28T00:16:33.164225+0000","last_undegraded":"2023-09-28T00:16:33.164225+0000","last_fullsized":"2023-09-28T00:16:33.164225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:33.164102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:33.164102+0000","last_clean_scrub_stamp":"2023-09-28T00:16:33.164102+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T01:44:14.104127+0000","scrub_duration":0.0013507339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"26'4","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:12.815843+0000","last_change":"2023-09-28T00:16:12.815812+0000","last_active":"2023-09-28T00:16:12.815843+0000","last_peered":"2023-09-28T00:16:12.815843+0000","last_clean":"2023-09-28T00:16:12.815843+0000","last_became_active":"2023-09-28T00:15:28.985057+0000","last_became_peered":"2023-09-28T00:15:28.985057+0000","last_unstale":"2023-09-28T00:16:12.815843+0000","last_undegraded":"2023-09-28T00:16:12.815843+0000","last_fullsized":"2023-09-28T00:16:12.815843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'4","last_scrub_stamp":"2023-09-28T00:16:12.815704+0000","last_deep_scrub":"26'4","last_deep_scrub_stamp":"2023-09-28T00:16:12.815704+0000","last_clean_scrub_stamp":"2023-09-28T00:16:12.815704+0000","objects_scrubbed":2,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:39.870457+0000","scrub_duration":0.0060367390000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:20.882824+0000","last_change":"2023-09-28T00:16:20.882793+0000","last_active":"2023-09-28T00:16:20.882824+0000","last_peered":"2023-09-28T00:16:20.882824+0000","last_clean":"2023-09-28T00:16:20.882824+0000","last_became_active":"2023-09-28T00:15:29.383056+0000","last_became_peered":"2023-09-28T00:15:29.383056+0000","last_unstale":"2023-09-28T00:16:20.882824+0000","last_undegraded":"2023-09-28T00:16:20.882824+0000","last_fullsized":"2023-09-28T00:16:20.882824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:20.882680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:20.882680+0000","last_clean_scrub_stamp":"2023-09-28T00:16:20.882680+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:23.940800+0000","scrub_duration":0.001535137,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230230+0000","last_change":"2023-09-28T00:15:48.622966+0000","last_active":"2023-09-28T00:16:10.230230+0000","last_peered":"2023-09-28T00:16:10.230230+0000","last_clean":"2023-09-28T00:16:10.230230+0000","last_became_active":"2023-09-28T00:15:28.986107+0000","last_became_peered":"2023-09-28T00:15:28.986107+0000","last_unstale":"2023-09-28T00:16:10.230230+0000","last_undegraded":"2023-09-28T00:16:10.230230+0000","last_fullsized":"2023-09-28T00:16:10.230230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:48.622809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:48.622809+0000","last_clean_scrub_stamp":"2023-09-28T00:15:48.622809+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:04:59.170139+0000","scrub_duration":0.0017786600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:21.269798+0000","last_change":"2023-09-28T00:16:21.269769+0000","last_active":"2023-09-28T00:16:21.269798+0000","last_peered":"2023-09-28T00:16:21.269798+0000","last_clean":"2023-09-28T00:16:21.269798+0000","last_became_active":"2023-09-28T00:15:29.390129+0000","last_became_peered":"2023-09-28T00:15:29.390129+0000","last_unstale":"2023-09-28T00:16:21.269798+0000","last_undegraded":"2023-09-28T00:16:21.269798+0000","last_fullsized":"2023-09-28T00:16:21.269798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:21.269658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:21.269658+0000","last_clean_scrub_stamp":"2023-09-28T00:16:21.269658+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:24.327778+0000","scrub_duration":0.00139431,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.822261+0000","last_change":"2023-09-28T00:16:11.822235+0000","last_active":"2023-09-28T00:16:11.822261+0000","last_peered":"2023-09-28T00:16:11.822261+0000","last_clean":"2023-09-28T00:16:11.822261+0000","last_became_active":"2023-09-28T00:15:28.985126+0000","last_became_peered":"2023-09-28T00:15:28.985126+0000","last_unstale":"2023-09-28T00:16:11.822261+0000","last_undegraded":"2023-09-28T00:16:11.822261+0000","last_fullsized":"2023-09-28T00:16:11.822261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:11.822134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:11.822134+0000","last_clean_scrub_stamp":"2023-09-28T00:16:11.822134+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:11.801964+0000","scrub_duration":0.0015678759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:38.286864+0000","last_change":"2023-09-28T00:16:38.286835+0000","last_active":"2023-09-28T00:16:38.286864+0000","last_peered":"2023-09-28T00:16:38.286864+0000","last_clean":"2023-09-28T00:16:38.286864+0000","last_became_active":"2023-09-28T00:15:29.399075+0000","last_became_peered":"2023-09-28T00:15:29.399075+0000","last_unstale":"2023-09-28T00:16:38.286864+0000","last_undegraded":"2023-09-28T00:16:38.286864+0000","last_fullsized":"2023-09-28T00:16:38.286864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:38.286718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:38.286718+0000","last_clean_scrub_stamp":"2023-09-28T00:16:38.286718+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:30:43.865312+0000","scrub_duration":0.001606768,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.229752+0000","last_change":"2023-09-28T00:15:56.332960+0000","last_active":"2023-09-28T00:16:10.229752+0000","last_peered":"2023-09-28T00:16:10.229752+0000","last_clean":"2023-09-28T00:16:10.229752+0000","last_became_active":"2023-09-28T00:15:28.983007+0000","last_became_peered":"2023-09-28T00:15:28.983007+0000","last_unstale":"2023-09-28T00:16:10.229752+0000","last_undegraded":"2023-09-28T00:16:10.229752+0000","last_fullsized":"2023-09-28T00:16:10.229752+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'8","last_scrub_stamp":"2023-09-28T00:15:56.332853+0000","last_deep_scrub":"23'8","last_deep_scrub_stamp":"2023-09-28T00:15:56.332853+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.332853+0000","objects_scrubbed":4,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:45.230235+0000","scrub_duration":0.0027676580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:18.843081+0000","last_change":"2023-09-28T00:16:18.843034+0000","last_active":"2023-09-28T00:16:18.843081+0000","last_peered":"2023-09-28T00:16:18.843081+0000","last_clean":"2023-09-28T00:16:18.843081+0000","last_became_active":"2023-09-28T00:15:29.393557+0000","last_became_peered":"2023-09-28T00:15:29.393557+0000","last_unstale":"2023-09-28T00:16:18.843081+0000","last_undegraded":"2023-09-28T00:16:18.843081+0000","last_fullsized":"2023-09-28T00:16:18.843081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:18.842921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:18.842921+0000","last_clean_scrub_stamp":"2023-09-28T00:16:18.842921+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:15:57.839685+0000","scrub_duration":0.001917796,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:16.891280+0000","last_change":"2023-09-28T00:16:16.891250+0000","last_active":"2023-09-28T00:16:16.891280+0000","last_peered":"2023-09-28T00:16:16.891280+0000","last_clean":"2023-09-28T00:16:16.891280+0000","last_became_active":"2023-09-28T00:15:28.984854+0000","last_became_peered":"2023-09-28T00:15:28.984854+0000","last_unstale":"2023-09-28T00:16:16.891280+0000","last_undegraded":"2023-09-28T00:16:16.891280+0000","last_fullsized":"2023-09-28T00:16:16.891280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-09-28T00:16:16.891131+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-09-28T00:16:16.891131+0000","last_clean_scrub_stamp":"2023-09-28T00:16:16.891131+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:36:20.909174+0000","scrub_duration":0.0030910569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:19.327428+0000","last_change":"2023-09-28T00:16:19.327391+0000","last_active":"2023-09-28T00:16:19.327428+0000","last_peered":"2023-09-28T00:16:19.327428+0000","last_clean":"2023-09-28T00:16:19.327428+0000","last_became_active":"2023-09-28T00:15:29.393188+0000","last_became_peered":"2023-09-28T00:15:29.393188+0000","last_unstale":"2023-09-28T00:16:19.327428+0000","last_undegraded":"2023-09-28T00:16:19.327428+0000","last_fullsized":"2023-09-28T00:16:19.327428+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:19.327292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:19.327292+0000","last_clean_scrub_stamp":"2023-09-28T00:16:19.327292+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:15:58.324056+0000","scrub_duration":0.001328889,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:22.890472+0000","last_change":"2023-09-28T00:16:22.890422+0000","last_active":"2023-09-28T00:16:22.890472+0000","last_peered":"2023-09-28T00:16:22.890472+0000","last_clean":"2023-09-28T00:16:22.890472+0000","last_became_active":"2023-09-28T00:15:28.985787+0000","last_became_peered":"2023-09-28T00:15:28.985787+0000","last_unstale":"2023-09-28T00:16:22.890472+0000","last_undegraded":"2023-09-28T00:16:22.890472+0000","last_fullsized":"2023-09-28T00:16:22.890472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-09-28T00:16:22.890296+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-09-28T00:16:22.890296+0000","last_clean_scrub_stamp":"2023-09-28T00:16:22.890296+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:02:23.281419+0000","scrub_duration":0.0030682890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:37.235109+0000","last_change":"2023-09-28T00:16:37.235076+0000","last_active":"2023-09-28T00:16:37.235109+0000","last_peered":"2023-09-28T00:16:37.235109+0000","last_clean":"2023-09-28T00:16:37.235109+0000","last_became_active":"2023-09-28T00:15:29.393624+0000","last_became_peered":"2023-09-28T00:15:29.393624+0000","last_unstale":"2023-09-28T00:16:37.235109+0000","last_undegraded":"2023-09-28T00:16:37.235109+0000","last_fullsized":"2023-09-28T00:16:37.235109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:37.234965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:37.234965+0000","last_clean_scrub_stamp":"2023-09-28T00:16:37.234965+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:41:45.082287+0000","scrub_duration":0.0022124879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"26'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:20.922896+0000","last_change":"2023-09-28T00:16:20.922865+0000","last_active":"2023-09-28T00:16:20.922896+0000","last_peered":"2023-09-28T00:16:20.922896+0000","last_clean":"2023-09-28T00:16:20.922896+0000","last_became_active":"2023-09-28T00:15:28.982127+0000","last_became_peered":"2023-09-28T00:15:28.982127+0000","last_unstale":"2023-09-28T00:16:20.922896+0000","last_undegraded":"2023-09-28T00:16:20.922896+0000","last_fullsized":"2023-09-28T00:16:20.922896+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'2","last_scrub_stamp":"2023-09-28T00:16:20.922756+0000","last_deep_scrub":"26'2","last_deep_scrub_stamp":"2023-09-28T00:16:20.922756+0000","last_clean_scrub_stamp":"2023-09-28T00:16:20.922756+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:48.347984+0000","scrub_duration":0.0029637520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:13.119163+0000","last_change":"2023-09-28T00:16:13.119137+0000","last_active":"2023-09-28T00:16:13.119163+0000","last_peered":"2023-09-28T00:16:13.119163+0000","last_clean":"2023-09-28T00:16:13.119163+0000","last_became_active":"2023-09-28T00:15:29.388501+0000","last_became_peered":"2023-09-28T00:15:29.388501+0000","last_unstale":"2023-09-28T00:16:13.119163+0000","last_undegraded":"2023-09-28T00:16:13.119163+0000","last_fullsized":"2023-09-28T00:16:13.119163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:13.119037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:13.119037+0000","last_clean_scrub_stamp":"2023-09-28T00:16:13.119037+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:12:37.180413+0000","scrub_duration":0.0020019500000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022341+0000","last_change":"2023-09-28T00:16:08.420377+0000","last_active":"2023-09-28T00:16:10.022341+0000","last_peered":"2023-09-28T00:16:10.022341+0000","last_clean":"2023-09-28T00:16:10.022341+0000","last_became_active":"2023-09-28T00:15:28.983789+0000","last_became_peered":"2023-09-28T00:15:28.983789+0000","last_unstale":"2023-09-28T00:16:10.022341+0000","last_undegraded":"2023-09-28T00:16:10.022341+0000","last_fullsized":"2023-09-28T00:16:10.022341+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:08.420273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:08.420273+0000","last_clean_scrub_stamp":"2023-09-28T00:16:08.420273+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:08.400103+0000","scrub_duration":0.001767086,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:19.538406+0000","last_change":"2023-09-28T00:16:19.538359+0000","last_active":"2023-09-28T00:16:19.538406+0000","last_peered":"2023-09-28T00:16:19.538406+0000","last_clean":"2023-09-28T00:16:19.538406+0000","last_became_active":"2023-09-28T00:15:29.386520+0000","last_became_peered":"2023-09-28T00:15:29.386520+0000","last_unstale":"2023-09-28T00:16:19.538406+0000","last_undegraded":"2023-09-28T00:16:19.538406+0000","last_fullsized":"2023-09-28T00:16:19.538406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:19.538238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:19.538238+0000","last_clean_scrub_stamp":"2023-09-28T00:16:19.538238+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:22.596358+0000","scrub_duration":0.0015910309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018635+0000","last_change":"2023-09-28T00:15:53.885189+0000","last_active":"2023-09-28T00:16:10.018635+0000","last_peered":"2023-09-28T00:16:10.018635+0000","last_clean":"2023-09-28T00:16:10.018635+0000","last_became_active":"2023-09-28T00:15:28.985584+0000","last_became_peered":"2023-09-28T00:15:28.985584+0000","last_unstale":"2023-09-28T00:16:10.018635+0000","last_undegraded":"2023-09-28T00:16:10.018635+0000","last_fullsized":"2023-09-28T00:16:10.018635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-28T00:15:53.885072+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-28T00:15:53.885072+0000","last_clean_scrub_stamp":"2023-09-28T00:15:53.885072+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:43.628028+0000","scrub_duration":0.0020480469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.020155+0000","last_change":"2023-09-28T00:15:53.159199+0000","last_active":"2023-09-28T00:16:10.020155+0000","last_peered":"2023-09-28T00:16:10.020155+0000","last_clean":"2023-09-28T00:16:10.020155+0000","last_became_active":"2023-09-28T00:15:29.392909+0000","last_became_peered":"2023-09-28T00:15:29.392909+0000","last_unstale":"2023-09-28T00:16:10.020155+0000","last_undegraded":"2023-09-28T00:16:10.020155+0000","last_fullsized":"2023-09-28T00:16:10.020155+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:53.159094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:53.159094+0000","last_clean_scrub_stamp":"2023-09-28T00:15:53.159094+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:10.750775+0000","scrub_duration":0.0021930320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.229888+0000","last_change":"2023-09-28T00:16:03.295793+0000","last_active":"2023-09-28T00:16:10.229888+0000","last_peered":"2023-09-28T00:16:10.229888+0000","last_clean":"2023-09-28T00:16:10.229888+0000","last_became_active":"2023-09-28T00:15:28.984998+0000","last_became_peered":"2023-09-28T00:15:28.984998+0000","last_unstale":"2023-09-28T00:16:10.229888+0000","last_undegraded":"2023-09-28T00:16:10.229888+0000","last_fullsized":"2023-09-28T00:16:10.229888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:03.295686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:03.295686+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.295686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:32:37.484631+0000","scrub_duration":0.0016463370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:21.085990+0000","last_change":"2023-09-28T00:16:21.085959+0000","last_active":"2023-09-28T00:16:21.085990+0000","last_peered":"2023-09-28T00:16:21.085990+0000","last_clean":"2023-09-28T00:16:21.085990+0000","last_became_active":"2023-09-28T00:15:29.399580+0000","last_became_peered":"2023-09-28T00:15:29.399580+0000","last_unstale":"2023-09-28T00:16:21.085990+0000","last_undegraded":"2023-09-28T00:16:21.085990+0000","last_fullsized":"2023-09-28T00:16:21.085990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:21.085837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:21.085837+0000","last_clean_scrub_stamp":"2023-09-28T00:16:21.085837+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:53:06.144871+0000","scrub_duration":0.0018921859999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019573+0000","last_change":"2023-09-28T00:16:01.173298+0000","last_active":"2023-09-28T00:16:10.019573+0000","last_peered":"2023-09-28T00:16:10.019573+0000","last_clean":"2023-09-28T00:16:10.019573+0000","last_became_active":"2023-09-28T00:15:28.979871+0000","last_became_peered":"2023-09-28T00:15:28.979871+0000","last_unstale":"2023-09-28T00:16:10.019573+0000","last_undegraded":"2023-09-28T00:16:10.019573+0000","last_fullsized":"2023-09-28T00:16:10.019573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:01.173171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:01.173171+0000","last_clean_scrub_stamp":"2023-09-28T00:16:01.173171+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:27:28.227924+0000","scrub_duration":0.0020952499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.020044+0000","last_change":"2023-09-28T00:16:00.181152+0000","last_active":"2023-09-28T00:16:10.020044+0000","last_peered":"2023-09-28T00:16:10.020044+0000","last_clean":"2023-09-28T00:16:10.020044+0000","last_became_active":"2023-09-28T00:15:29.397453+0000","last_became_peered":"2023-09-28T00:15:29.397453+0000","last_unstale":"2023-09-28T00:16:10.020044+0000","last_undegraded":"2023-09-28T00:16:10.020044+0000","last_fullsized":"2023-09-28T00:16:10.020044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:00.181000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:00.181000+0000","last_clean_scrub_stamp":"2023-09-28T00:16:00.181000+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:00.160829+0000","scrub_duration":0.0017584429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.017681+0000","last_change":"2023-09-28T00:15:49.877522+0000","last_active":"2023-09-28T00:16:10.017681+0000","last_peered":"2023-09-28T00:16:10.017681+0000","last_clean":"2023-09-28T00:16:10.017681+0000","last_became_active":"2023-09-28T00:15:28.986153+0000","last_became_peered":"2023-09-28T00:15:28.986153+0000","last_unstale":"2023-09-28T00:16:10.017681+0000","last_undegraded":"2023-09-28T00:16:10.017681+0000","last_fullsized":"2023-09-28T00:16:10.017681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:49.877418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:49.877418+0000","last_clean_scrub_stamp":"2023-09-28T00:15:49.877418+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:05:00.424748+0000","scrub_duration":0.0014756789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.023638+0000","last_change":"2023-09-28T00:16:11.023638+0000","last_active":"2023-09-28T00:16:11.023638+0000","last_peered":"2023-09-28T00:16:11.023638+0000","last_clean":"2023-09-28T00:16:11.023638+0000","last_became_active":"2023-09-28T00:16:11.023326+0000","last_became_peered":"2023-09-28T00:16:11.023326+0000","last_unstale":"2023-09-28T00:16:11.023638+0000","last_undegraded":"2023-09-28T00:16:11.023638+0000","last_fullsized":"2023-09-28T00:16:11.023638+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:08.509135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:08.509135+0000","last_clean_scrub_stamp":"2023-09-28T00:16:08.509135+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:45:14.615373+0000","scrub_duration":0.001728788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025013+0000","last_change":"2023-09-28T00:15:48.686393+0000","last_active":"2023-09-28T00:16:10.025013+0000","last_peered":"2023-09-28T00:16:10.025013+0000","last_clean":"2023-09-28T00:16:10.025013+0000","last_became_active":"2023-09-28T00:15:24.192997+0000","last_became_peered":"2023-09-28T00:15:24.192997+0000","last_unstale":"2023-09-28T00:16:10.025013+0000","last_undegraded":"2023-09-28T00:16:10.025013+0000","last_fullsized":"2023-09-28T00:16:10.025013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:48.686304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:48.686304+0000","last_clean_scrub_stamp":"2023-09-28T00:15:48.686304+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:44:37.583686+0000","scrub_duration":0.0013027640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:15.364417+0000","last_change":"2023-09-28T00:16:15.364382+0000","last_active":"2023-09-28T00:16:15.364417+0000","last_peered":"2023-09-28T00:16:15.364417+0000","last_clean":"2023-09-28T00:16:15.364417+0000","last_became_active":"2023-09-28T00:15:28.985883+0000","last_became_peered":"2023-09-28T00:15:28.985883+0000","last_unstale":"2023-09-28T00:16:15.364417+0000","last_undegraded":"2023-09-28T00:16:15.364417+0000","last_fullsized":"2023-09-28T00:16:15.364417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:15.364267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:15.364267+0000","last_clean_scrub_stamp":"2023-09-28T00:16:15.364267+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:04:42.789495+0000","scrub_duration":0.001565421,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.024765+0000","last_change":"2023-09-28T00:16:05.593506+0000","last_active":"2023-09-28T00:16:10.024765+0000","last_peered":"2023-09-28T00:16:10.024765+0000","last_clean":"2023-09-28T00:16:10.024765+0000","last_became_active":"2023-09-28T00:15:29.387375+0000","last_became_peered":"2023-09-28T00:15:29.387375+0000","last_unstale":"2023-09-28T00:16:10.024765+0000","last_undegraded":"2023-09-28T00:16:10.024765+0000","last_fullsized":"2023-09-28T00:16:10.024765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.593397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.593397+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.593397+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:05:10.223613+0000","scrub_duration":0.0020412870000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022038+0000","last_change":"2023-09-28T00:16:00.498971+0000","last_active":"2023-09-28T00:16:10.022038+0000","last_peered":"2023-09-28T00:16:10.022038+0000","last_clean":"2023-09-28T00:16:10.022038+0000","last_became_active":"2023-09-28T00:15:23.950182+0000","last_became_peered":"2023-09-28T00:15:23.950182+0000","last_unstale":"2023-09-28T00:16:10.022038+0000","last_undegraded":"2023-09-28T00:16:10.022038+0000","last_fullsized":"2023-09-28T00:16:10.022038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:00.498859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:00.498859+0000","last_clean_scrub_stamp":"2023-09-28T00:16:00.498859+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:18.090540+0000","scrub_duration":0.0020023010000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019966+0000","last_change":"2023-09-28T00:16:05.136936+0000","last_active":"2023-09-28T00:16:10.019966+0000","last_peered":"2023-09-28T00:16:10.019966+0000","last_clean":"2023-09-28T00:16:10.019966+0000","last_became_active":"2023-09-28T00:15:28.984295+0000","last_became_peered":"2023-09-28T00:15:28.984295+0000","last_unstale":"2023-09-28T00:16:10.019966+0000","last_undegraded":"2023-09-28T00:16:10.019966+0000","last_fullsized":"2023-09-28T00:16:10.019966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:05.136820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:05.136820+0000","last_clean_scrub_stamp":"2023-09-28T00:16:05.136820+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:36:09.154862+0000","scrub_duration":0.00184125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025056+0000","last_change":"2023-09-28T00:16:07.548108+0000","last_active":"2023-09-28T00:16:10.025056+0000","last_peered":"2023-09-28T00:16:10.025056+0000","last_clean":"2023-09-28T00:16:10.025056+0000","last_became_active":"2023-09-28T00:15:29.392065+0000","last_became_peered":"2023-09-28T00:15:29.392065+0000","last_unstale":"2023-09-28T00:16:10.025056+0000","last_undegraded":"2023-09-28T00:16:10.025056+0000","last_fullsized":"2023-09-28T00:16:10.025056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:07.548002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:07.548002+0000","last_clean_scrub_stamp":"2023-09-28T00:16:07.548002+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:07.527832+0000","scrub_duration":0.001605205,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023165+0000","last_change":"2023-09-28T00:15:49.304707+0000","last_active":"2023-09-28T00:16:10.023165+0000","last_peered":"2023-09-28T00:16:10.023165+0000","last_clean":"2023-09-28T00:16:10.023165+0000","last_became_active":"2023-09-28T00:15:24.193271+0000","last_became_peered":"2023-09-28T00:15:24.193271+0000","last_unstale":"2023-09-28T00:16:10.023165+0000","last_undegraded":"2023-09-28T00:16:10.023165+0000","last_fullsized":"2023-09-28T00:16:10.023165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:49.304605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:49.304605+0000","last_clean_scrub_stamp":"2023-09-28T00:15:49.304605+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:13:31.322663+0000","scrub_duration":0.0012867289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.024542+0000","last_change":"2023-09-28T00:16:00.590315+0000","last_active":"2023-09-28T00:16:10.024542+0000","last_peered":"2023-09-28T00:16:10.024542+0000","last_clean":"2023-09-28T00:16:10.024542+0000","last_became_active":"2023-09-28T00:15:28.979968+0000","last_became_peered":"2023-09-28T00:15:28.979968+0000","last_unstale":"2023-09-28T00:16:10.024542+0000","last_undegraded":"2023-09-28T00:16:10.024542+0000","last_fullsized":"2023-09-28T00:16:10.024542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:00.590197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:00.590197+0000","last_clean_scrub_stamp":"2023-09-28T00:16:00.590197+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:18.181878+0000","scrub_duration":0.0017790499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:19.616202+0000","last_change":"2023-09-28T00:16:19.616163+0000","last_active":"2023-09-28T00:16:19.616202+0000","last_peered":"2023-09-28T00:16:19.616202+0000","last_clean":"2023-09-28T00:16:19.616202+0000","last_became_active":"2023-09-28T00:15:29.387241+0000","last_became_peered":"2023-09-28T00:15:29.387241+0000","last_unstale":"2023-09-28T00:16:19.616202+0000","last_undegraded":"2023-09-28T00:16:19.616202+0000","last_fullsized":"2023-09-28T00:16:19.616202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:19.616063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:19.616063+0000","last_clean_scrub_stamp":"2023-09-28T00:16:19.616063+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:10.315049+0000","scrub_duration":0.0017686920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022188+0000","last_change":"2023-09-28T00:15:55.506327+0000","last_active":"2023-09-28T00:16:10.022188+0000","last_peered":"2023-09-28T00:16:10.022188+0000","last_clean":"2023-09-28T00:16:10.022188+0000","last_became_active":"2023-09-28T00:15:23.950160+0000","last_became_peered":"2023-09-28T00:15:23.950160+0000","last_unstale":"2023-09-28T00:16:10.022188+0000","last_undegraded":"2023-09-28T00:16:10.022188+0000","last_fullsized":"2023-09-28T00:16:10.022188+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:55.506216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:55.506216+0000","last_clean_scrub_stamp":"2023-09-28T00:15:55.506216+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:34.313252+0000","scrub_duration":0.0022483070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'119","reported_seq":181,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018670+0000","last_change":"2023-09-28T00:15:58.809117+0000","last_active":"2023-09-28T00:16:10.018670+0000","last_peered":"2023-09-28T00:16:10.018670+0000","last_clean":"2023-09-28T00:16:10.018670+0000","last_became_active":"2023-09-28T00:15:16.994191+0000","last_became_peered":"2023-09-28T00:15:16.994191+0000","last_unstale":"2023-09-28T00:16:10.018670+0000","last_undegraded":"2023-09-28T00:16:10.018670+0000","last_fullsized":"2023-09-28T00:16:10.018670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'119","last_scrub_stamp":"2023-09-28T00:15:58.809014+0000","last_deep_scrub":"24'119","last_deep_scrub_stamp":"2023-09-28T00:15:58.809014+0000","last_clean_scrub_stamp":"2023-09-28T00:15:58.809014+0000","objects_scrubbed":2,"log_size":119,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:37.616051+0000","scrub_duration":0.0056860469999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018035+0000","last_change":"2023-09-28T00:15:51.870215+0000","last_active":"2023-09-28T00:16:10.018035+0000","last_peered":"2023-09-28T00:16:10.018035+0000","last_clean":"2023-09-28T00:16:10.018035+0000","last_became_active":"2023-09-28T00:15:28.984738+0000","last_became_peered":"2023-09-28T00:15:28.984738+0000","last_unstale":"2023-09-28T00:16:10.018035+0000","last_undegraded":"2023-09-28T00:16:10.018035+0000","last_fullsized":"2023-09-28T00:16:10.018035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:51.870131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:51.870131+0000","last_clean_scrub_stamp":"2023-09-28T00:15:51.870131+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:32:26.059076+0000","scrub_duration":0.0018609810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.156585+0000","last_change":"2023-09-28T00:16:11.156557+0000","last_active":"2023-09-28T00:16:11.156585+0000","last_peered":"2023-09-28T00:16:11.156585+0000","last_clean":"2023-09-28T00:16:11.156585+0000","last_became_active":"2023-09-28T00:15:29.401555+0000","last_became_peered":"2023-09-28T00:15:29.401555+0000","last_unstale":"2023-09-28T00:16:11.156585+0000","last_undegraded":"2023-09-28T00:16:11.156585+0000","last_fullsized":"2023-09-28T00:16:11.156585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:11.156450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:11.156450+0000","last_clean_scrub_stamp":"2023-09-28T00:16:11.156450+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:59.454248+0000","scrub_duration":0.0040147280000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018831+0000","last_change":"2023-09-28T00:16:03.753189+0000","last_active":"2023-09-28T00:16:10.018831+0000","last_peered":"2023-09-28T00:16:10.018831+0000","last_clean":"2023-09-28T00:16:10.018831+0000","last_became_active":"2023-09-28T00:15:23.946402+0000","last_became_peered":"2023-09-28T00:15:23.946402+0000","last_unstale":"2023-09-28T00:16:10.018831+0000","last_undegraded":"2023-09-28T00:16:10.018831+0000","last_fullsized":"2023-09-28T00:16:10.018831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:03.753087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:03.753087+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.753087+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:21.344768+0000","scrub_duration":0.0022902560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230180+0000","last_change":"2023-09-28T00:16:01.732279+0000","last_active":"2023-09-28T00:16:10.230180+0000","last_peered":"2023-09-28T00:16:10.230180+0000","last_clean":"2023-09-28T00:16:10.230180+0000","last_became_active":"2023-09-28T00:15:28.986135+0000","last_became_peered":"2023-09-28T00:15:28.986135+0000","last_unstale":"2023-09-28T00:16:10.230180+0000","last_undegraded":"2023-09-28T00:16:10.230180+0000","last_fullsized":"2023-09-28T00:16:10.230180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:01.732160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:01.732160+0000","last_clean_scrub_stamp":"2023-09-28T00:16:01.732160+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:05:06.362375+0000","scrub_duration":0.0018186770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:15.572369+0000","last_change":"2023-09-28T00:16:15.572323+0000","last_active":"2023-09-28T00:16:15.572369+0000","last_peered":"2023-09-28T00:16:15.572369+0000","last_clean":"2023-09-28T00:16:15.572369+0000","last_became_active":"2023-09-28T00:15:29.390042+0000","last_became_peered":"2023-09-28T00:15:29.390042+0000","last_unstale":"2023-09-28T00:16:15.572369+0000","last_undegraded":"2023-09-28T00:16:15.572369+0000","last_fullsized":"2023-09-28T00:16:15.572369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:15.572201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:15.572201+0000","last_clean_scrub_stamp":"2023-09-28T00:16:15.572201+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:06.271188+0000","scrub_duration":0.001609982,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019896+0000","last_change":"2023-09-28T00:16:06.787743+0000","last_active":"2023-09-28T00:16:10.019896+0000","last_peered":"2023-09-28T00:16:10.019896+0000","last_clean":"2023-09-28T00:16:10.019896+0000","last_became_active":"2023-09-28T00:15:24.193017+0000","last_became_peered":"2023-09-28T00:15:24.193017+0000","last_unstale":"2023-09-28T00:16:10.019896+0000","last_undegraded":"2023-09-28T00:16:10.019896+0000","last_fullsized":"2023-09-28T00:16:10.019896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:06.787615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:06.787615+0000","last_clean_scrub_stamp":"2023-09-28T00:16:06.787615+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:55.085413+0000","scrub_duration":0.002110392,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025118+0000","last_change":"2023-09-28T00:15:57.594832+0000","last_active":"2023-09-28T00:16:10.025118+0000","last_peered":"2023-09-28T00:16:10.025118+0000","last_clean":"2023-09-28T00:16:10.025118+0000","last_became_active":"2023-09-28T00:15:28.979415+0000","last_became_peered":"2023-09-28T00:15:28.979415+0000","last_unstale":"2023-09-28T00:16:10.025118+0000","last_undegraded":"2023-09-28T00:16:10.025118+0000","last_fullsized":"2023-09-28T00:16:10.025118+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:57.594711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:57.594711+0000","last_clean_scrub_stamp":"2023-09-28T00:15:57.594711+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:47.337667+0000","scrub_duration":0.001619428,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:20.512282+0000","last_change":"2023-09-28T00:16:20.512235+0000","last_active":"2023-09-28T00:16:20.512282+0000","last_peered":"2023-09-28T00:16:20.512282+0000","last_clean":"2023-09-28T00:16:20.512282+0000","last_became_active":"2023-09-28T00:15:29.398720+0000","last_became_peered":"2023-09-28T00:15:29.398720+0000","last_unstale":"2023-09-28T00:16:20.512282+0000","last_undegraded":"2023-09-28T00:16:20.512282+0000","last_fullsized":"2023-09-28T00:16:20.512282+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:20.512121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:20.512121+0000","last_clean_scrub_stamp":"2023-09-28T00:16:20.512121+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:50.413154+0000","scrub_duration":0.0018353989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018329+0000","last_change":"2023-09-28T00:15:52.853832+0000","last_active":"2023-09-28T00:16:10.018329+0000","last_peered":"2023-09-28T00:16:10.018329+0000","last_clean":"2023-09-28T00:16:10.018329+0000","last_became_active":"2023-09-28T00:15:28.988839+0000","last_became_peered":"2023-09-28T00:15:28.988839+0000","last_unstale":"2023-09-28T00:16:10.018329+0000","last_undegraded":"2023-09-28T00:16:10.018329+0000","last_fullsized":"2023-09-28T00:16:10.018329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'2","last_scrub_stamp":"2023-09-28T00:15:52.853723+0000","last_deep_scrub":"23'2","last_deep_scrub_stamp":"2023-09-28T00:15:52.853723+0000","last_clean_scrub_stamp":"2023-09-28T00:15:52.853723+0000","objects_scrubbed":1,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T02:08:31.660759+0000","scrub_duration":0.0022132520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.025138+0000","last_change":"2023-09-28T00:15:52.639926+0000","last_active":"2023-09-28T00:16:10.025138+0000","last_peered":"2023-09-28T00:16:10.025138+0000","last_clean":"2023-09-28T00:16:10.025138+0000","last_became_active":"2023-09-28T00:15:23.949089+0000","last_became_peered":"2023-09-28T00:15:23.949089+0000","last_unstale":"2023-09-28T00:16:10.025138+0000","last_undegraded":"2023-09-28T00:16:10.025138+0000","last_fullsized":"2023-09-28T00:16:10.025138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:52.639814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:52.639814+0000","last_clean_scrub_stamp":"2023-09-28T00:15:52.639814+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T04:05:03.187143+0000","scrub_duration":0.0017377740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:21.902985+0000","last_change":"2023-09-28T00:16:21.902942+0000","last_active":"2023-09-28T00:16:21.902985+0000","last_peered":"2023-09-28T00:16:21.902985+0000","last_clean":"2023-09-28T00:16:21.902985+0000","last_became_active":"2023-09-28T00:15:29.386237+0000","last_became_peered":"2023-09-28T00:15:29.386237+0000","last_unstale":"2023-09-28T00:16:21.902985+0000","last_undegraded":"2023-09-28T00:16:21.902985+0000","last_fullsized":"2023-09-28T00:16:21.902985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:21.902835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:21.902835+0000","last_clean_scrub_stamp":"2023-09-28T00:16:21.902835+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:51.803868+0000","scrub_duration":0.001900295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230047+0000","last_change":"2023-09-28T00:15:54.304435+0000","last_active":"2023-09-28T00:16:10.230047+0000","last_peered":"2023-09-28T00:16:10.230047+0000","last_clean":"2023-09-28T00:16:10.230047+0000","last_became_active":"2023-09-28T00:15:23.949364+0000","last_became_peered":"2023-09-28T00:15:23.949364+0000","last_unstale":"2023-09-28T00:16:10.230047+0000","last_undegraded":"2023-09-28T00:16:10.230047+0000","last_fullsized":"2023-09-28T00:16:10.230047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:54.304310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:54.304310+0000","last_clean_scrub_stamp":"2023-09-28T00:15:54.304310+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T00:49:16.397435+0000","scrub_duration":0.0015026149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230677+0000","last_change":"2023-09-28T00:15:53.627491+0000","last_active":"2023-09-28T00:16:10.230677+0000","last_peered":"2023-09-28T00:16:10.230677+0000","last_clean":"2023-09-28T00:16:10.230677+0000","last_became_active":"2023-09-28T00:15:28.987337+0000","last_became_peered":"2023-09-28T00:15:28.987337+0000","last_unstale":"2023-09-28T00:16:10.230677+0000","last_undegraded":"2023-09-28T00:16:10.230677+0000","last_fullsized":"2023-09-28T00:16:10.230677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2023-09-28T00:15:53.627380+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2023-09-28T00:15:53.627380+0000","last_clean_scrub_stamp":"2023-09-28T00:15:53.627380+0000","objects_scrubbed":1,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:17:43.370335+0000","scrub_duration":0.0019854999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.019557+0000","last_change":"2023-09-28T00:15:56.188990+0000","last_active":"2023-09-28T00:16:10.019557+0000","last_peered":"2023-09-28T00:16:10.019557+0000","last_clean":"2023-09-28T00:16:10.019557+0000","last_became_active":"2023-09-28T00:15:29.397908+0000","last_became_peered":"2023-09-28T00:15:29.397908+0000","last_unstale":"2023-09-28T00:16:10.019557+0000","last_undegraded":"2023-09-28T00:16:10.019557+0000","last_fullsized":"2023-09-28T00:16:10.019557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:56.188876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:56.188876+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.188876+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:44.486675+0000","scrub_duration":0.0016262119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230353+0000","last_change":"2023-09-28T00:15:56.746011+0000","last_active":"2023-09-28T00:16:10.230353+0000","last_peered":"2023-09-28T00:16:10.230353+0000","last_clean":"2023-09-28T00:16:10.230353+0000","last_became_active":"2023-09-28T00:15:28.986704+0000","last_became_peered":"2023-09-28T00:15:28.986704+0000","last_unstale":"2023-09-28T00:16:10.230353+0000","last_undegraded":"2023-09-28T00:16:10.230353+0000","last_fullsized":"2023-09-28T00:16:10.230353+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-09-28T00:15:56.745896+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-09-28T00:15:56.745896+0000","last_clean_scrub_stamp":"2023-09-28T00:15:56.745896+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:14.337578+0000","scrub_duration":0.00152447,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.023427+0000","last_change":"2023-09-28T00:15:50.315214+0000","last_active":"2023-09-28T00:16:10.023427+0000","last_peered":"2023-09-28T00:16:10.023427+0000","last_clean":"2023-09-28T00:16:10.023427+0000","last_became_active":"2023-09-28T00:15:29.383515+0000","last_became_peered":"2023-09-28T00:15:29.383515+0000","last_unstale":"2023-09-28T00:16:10.023427+0000","last_undegraded":"2023-09-28T00:16:10.023427+0000","last_fullsized":"2023-09-28T00:16:10.023427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:15:50.315106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:15:50.315106+0000","last_clean_scrub_stamp":"2023-09-28T00:15:50.315106+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:05:47.010373+0000","scrub_duration":0.0014511070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"26'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:11.438640+0000","last_change":"2023-09-28T00:16:11.438613+0000","last_active":"2023-09-28T00:16:11.438640+0000","last_peered":"2023-09-28T00:16:11.438640+0000","last_clean":"2023-09-28T00:16:11.438640+0000","last_became_active":"2023-09-28T00:15:28.987345+0000","last_became_peered":"2023-09-28T00:15:28.987345+0000","last_unstale":"2023-09-28T00:16:11.438640+0000","last_undegraded":"2023-09-28T00:16:11.438640+0000","last_fullsized":"2023-09-28T00:16:11.438640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'3","last_scrub_stamp":"2023-09-28T00:16:11.438496+0000","last_deep_scrub":"26'3","last_deep_scrub_stamp":"2023-09-28T00:16:11.438496+0000","last_clean_scrub_stamp":"2023-09-28T00:16:11.438496+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T06:36:15.456538+0000","scrub_duration":0.0027487670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:26.046948+0000","last_change":"2023-09-28T00:16:26.046907+0000","last_active":"2023-09-28T00:16:26.046948+0000","last_peered":"2023-09-28T00:16:26.046948+0000","last_clean":"2023-09-28T00:16:26.046948+0000","last_became_active":"2023-09-28T00:15:29.392624+0000","last_became_peered":"2023-09-28T00:15:29.392624+0000","last_unstale":"2023-09-28T00:16:26.046948+0000","last_undegraded":"2023-09-28T00:16:26.046948+0000","last_fullsized":"2023-09-28T00:16:26.046948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:26.046795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:26.046795+0000","last_clean_scrub_stamp":"2023-09-28T00:16:26.046795+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:21:23.170653+0000","scrub_duration":0.0017495989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"24'3","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.022483+0000","last_change":"2023-09-28T00:16:03.483521+0000","last_active":"2023-09-28T00:16:10.022483+0000","last_peered":"2023-09-28T00:16:10.022483+0000","last_clean":"2023-09-28T00:16:10.022483+0000","last_became_active":"2023-09-28T00:15:28.987710+0000","last_became_peered":"2023-09-28T00:15:28.987710+0000","last_unstale":"2023-09-28T00:16:10.022483+0000","last_undegraded":"2023-09-28T00:16:10.022483+0000","last_fullsized":"2023-09-28T00:16:10.022483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'3","last_scrub_stamp":"2023-09-28T00:16:03.483392+0000","last_deep_scrub":"24'3","last_deep_scrub_stamp":"2023-09-28T00:16:03.483392+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.483392+0000","objects_scrubbed":1,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:51.781190+0000","scrub_duration":0.0026205619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:15.113529+0000","last_change":"2023-09-28T00:16:15.113496+0000","last_active":"2023-09-28T00:16:15.113529+0000","last_peered":"2023-09-28T00:16:15.113529+0000","last_clean":"2023-09-28T00:16:15.113529+0000","last_became_active":"2023-09-28T00:15:29.392566+0000","last_became_peered":"2023-09-28T00:15:29.392566+0000","last_unstale":"2023-09-28T00:16:15.113529+0000","last_undegraded":"2023-09-28T00:16:15.113529+0000","last_fullsized":"2023-09-28T00:16:15.113529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:15.113374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:15.113374+0000","last_clean_scrub_stamp":"2023-09-28T00:16:15.113374+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:18.171493+0000","scrub_duration":0.0017812539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.018244+0000","last_change":"2023-09-28T00:15:59.949690+0000","last_active":"2023-09-28T00:16:10.018244+0000","last_peered":"2023-09-28T00:16:10.018244+0000","last_clean":"2023-09-28T00:16:10.018244+0000","last_became_active":"2023-09-28T00:15:28.983376+0000","last_became_peered":"2023-09-28T00:15:28.983376+0000","last_unstale":"2023-09-28T00:16:10.018244+0000","last_undegraded":"2023-09-28T00:16:10.018244+0000","last_fullsized":"2023-09-28T00:16:10.018244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"23'1","last_scrub_stamp":"2023-09-28T00:15:59.949496+0000","last_deep_scrub":"23'1","last_deep_scrub_stamp":"2023-09-28T00:15:59.949496+0000","last_clean_scrub_stamp":"2023-09-28T00:15:59.949496+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T09:51:48.247295+0000","scrub_duration":0.0018437670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:33.024892+0000","last_change":"2023-09-28T00:16:33.024854+0000","last_active":"2023-09-28T00:16:33.024892+0000","last_peered":"2023-09-28T00:16:33.024892+0000","last_clean":"2023-09-28T00:16:33.024892+0000","last_became_active":"2023-09-28T00:15:29.384317+0000","last_became_peered":"2023-09-28T00:15:29.384317+0000","last_unstale":"2023-09-28T00:16:33.024892+0000","last_undegraded":"2023-09-28T00:16:33.024892+0000","last_fullsized":"2023-09-28T00:16:33.024892+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:33.024751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:33.024751+0000","last_clean_scrub_stamp":"2023-09-28T00:16:33.024751+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T05:21:30.148609+0000","scrub_duration":0.001501701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"24'6","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.230768+0000","last_change":"2023-09-28T00:16:03.661895+0000","last_active":"2023-09-28T00:16:10.230768+0000","last_peered":"2023-09-28T00:16:10.230768+0000","last_clean":"2023-09-28T00:16:10.230768+0000","last_became_active":"2023-09-28T00:15:28.984516+0000","last_became_peered":"2023-09-28T00:15:28.984516+0000","last_unstale":"2023-09-28T00:16:10.230768+0000","last_undegraded":"2023-09-28T00:16:10.230768+0000","last_fullsized":"2023-09-28T00:16:10.230768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'6","last_scrub_stamp":"2023-09-28T00:16:03.661795+0000","last_deep_scrub":"24'6","last_deep_scrub_stamp":"2023-09-28T00:16:03.661795+0000","last_clean_scrub_stamp":"2023-09-28T00:16:03.661795+0000","objects_scrubbed":2,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:16:03.641625+0000","scrub_duration":0.0039856939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:16.110694+0000","last_change":"2023-09-28T00:16:16.110663+0000","last_active":"2023-09-28T00:16:16.110694+0000","last_peered":"2023-09-28T00:16:16.110694+0000","last_clean":"2023-09-28T00:16:16.110694+0000","last_became_active":"2023-09-28T00:15:29.397341+0000","last_became_peered":"2023-09-28T00:15:29.397341+0000","last_unstale":"2023-09-28T00:16:16.110694+0000","last_undegraded":"2023-09-28T00:16:16.110694+0000","last_fullsized":"2023-09-28T00:16:16.110694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:16.110551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:16.110551+0000","last_clean_scrub_stamp":"2023-09-28T00:16:16.110551+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T11:51:46.011584+0000","scrub_duration":0.001688164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-09-28T00:16:10.229830+0000","last_change":"2023-09-28T00:16:08.212474+0000","last_active":"2023-09-28T00:16:10.229830+0000","last_peered":"2023-09-28T00:16:10.229830+0000","last_clean":"2023-09-28T00:16:10.229830+0000","last_became_active":"2023-09-28T00:15:29.394820+0000","last_became_peered":"2023-09-28T00:15:29.394820+0000","last_unstale":"2023-09-28T00:16:10.229830+0000","last_undegraded":"2023-09-28T00:16:10.229830+0000","last_fullsized":"2023-09-28T00:16:10.229830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:08.212359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:08.212359+0000","last_clean_scrub_stamp":"2023-09-28T00:16:08.212359+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T07:54:25.804040+0000","scrub_duration":0.0019597149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:35.946152+0000","last_change":"2023-09-28T00:16:35.946119+0000","last_active":"2023-09-28T00:16:35.946152+0000","last_peered":"2023-09-28T00:16:35.946152+0000","last_clean":"2023-09-28T00:16:35.946152+0000","last_became_active":"2023-09-28T00:15:29.383987+0000","last_became_peered":"2023-09-28T00:15:29.383987+0000","last_unstale":"2023-09-28T00:16:35.946152+0000","last_undegraded":"2023-09-28T00:16:35.946152+0000","last_fullsized":"2023-09-28T00:16:35.946152+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:35.946000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:35.946000+0000","last_clean_scrub_stamp":"2023-09-28T00:16:35.946000+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:42:58.205299+0000","scrub_duration":0.00166055,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:29.137534+0000","last_change":"2023-09-28T00:16:29.137505+0000","last_active":"2023-09-28T00:16:29.137534+0000","last_peered":"2023-09-28T00:16:29.137534+0000","last_clean":"2023-09-28T00:16:29.137534+0000","last_became_active":"2023-09-28T00:15:29.398907+0000","last_became_peered":"2023-09-28T00:15:29.398907+0000","last_unstale":"2023-09-28T00:16:29.137534+0000","last_undegraded":"2023-09-28T00:16:29.137534+0000","last_fullsized":"2023-09-28T00:16:29.137534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:29.137370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:29.137370+0000","last_clean_scrub_stamp":"2023-09-28T00:16:29.137370+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:42:51.396669+0000","scrub_duration":0.001534849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:16.769973+0000","last_change":"2023-09-28T00:16:16.769940+0000","last_active":"2023-09-28T00:16:16.769973+0000","last_peered":"2023-09-28T00:16:16.769973+0000","last_clean":"2023-09-28T00:16:16.769973+0000","last_became_active":"2023-09-28T00:15:29.388391+0000","last_became_peered":"2023-09-28T00:15:29.388391+0000","last_unstale":"2023-09-28T00:16:16.769973+0000","last_undegraded":"2023-09-28T00:16:16.769973+0000","last_fullsized":"2023-09-28T00:16:16.769973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:16.769822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:16.769822+0000","last_clean_scrub_stamp":"2023-09-28T00:16:16.769822+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T08:40:07.468808+0000","scrub_duration":0.002158989,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-09-28T00:16:23.625199+0000","last_change":"2023-09-28T00:16:23.625160+0000","last_active":"2023-09-28T00:16:23.625199+0000","last_peered":"2023-09-28T00:16:23.625199+0000","last_clean":"2023-09-28T00:16:23.625199+0000","last_became_active":"2023-09-28T00:15:29.388188+0000","last_became_peered":"2023-09-28T00:15:29.388188+0000","last_unstale":"2023-09-28T00:16:23.625199+0000","last_undegraded":"2023-09-28T00:16:23.625199+0000","last_fullsized":"2023-09-28T00:16:23.625199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-28T00:16:23.625057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-28T00:16:23.625057+0000","last_clean_scrub_stamp":"2023-09-28T00:16:23.625057+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-29T03:12:26.683177+0000","scrub_duration":0.0018831360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4880,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":6,"up_from":14,"seq":60129542167,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8020,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363820,"statfs":{"total":96636764160,"available":96628551680,"internally_reserved":0,"allocated":274432,"data_stored":105828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.499},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64100000000000001}]},{"osd":3,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.625},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Sep 28 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.67600000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542167,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8092,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363748,"statfs":{"total":96636764160,"available":96628477952,"internally_reserved":0,"allocated":282624,"data_stored":106452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.628},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.502}]},{"osd":3,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.376},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.55300000000000005}]},{"osd":7,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.66200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8148,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363692,"statfs":{"total":96636764160,"available":96628420608,"internally_reserved":0,"allocated":274432,"data_stored":105828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.28299999999999997}]},{"osd":2,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.0860000000000003,"5min":4.0860000000000003,"15min":4.0860000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":4.0599999999999996,"5min":4.0599999999999996,"15min":4.0599999999999996},"last":0.629},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.032,"5min":4.032,"15min":4.032},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.0019999999999998,"5min":4.0019999999999998,"15min":4.0019999999999998},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Sep 28 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":3.9620000000000002,"5min":3.9620000000000002,"15min":3.9620000000000002},"last":0.73999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9180,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362660,"statfs":{"total":96636764160,"available":96627363840,"internally_reserved":0,"allocated":872448,"data_stored":696750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.371},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":4.6719999999999997,"5min":4.6719999999999997,"15min":4.6719999999999997},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.314}]},{"osd":3,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.901,"5min":1.901,"15min":1.901},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.7800000000000002,"5min":4.7800000000000002,"15min":4.7800000000000002},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Sep 28 00:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":4.5640000000000001,"5min":4.5640000000000001,"15min":4.5640000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Sep 28 00:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":4.2610000000000001,"5min":4.2610000000000001,"15min":4.2610000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.7510000000000003,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Sep 28 00:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":4.7210000000000001,"5min":4.7210000000000001,"15min":4.7210000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":4.2439999999999998,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":4.4400000000000004,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.6929999999999996,"5min":4.6929999999999996,"15min":4.6929999999999996},"last":0.65200000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9268,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362572,"statfs":{"total":96636764160,"available":96627273728,"internally_reserved":0,"allocated":897024,"data_stored":697948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56799999999999995}]},{"osd":1,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.628}]},{"osd":2,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.61599999999999999}]},{"osd":3,"last update":"Thu Sep 28 00:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.39000000000000001}]},{"osd":5,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.438}]},{"osd":6,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59499999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8020,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363820,"statfs":{"total":96636764160,"available":96628551680,"internally_reserved":0,"allocated":274432,"data_stored":105828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.581,"5min":1.581,"15min":1.581},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.48899999999999999}]},{"osd":1,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":6.2990000000000004,"5min":6.2990000000000004,"15min":6.2990000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.439}]},{"osd":3,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":6.2679999999999998,"5min":6.2679999999999998,"15min":6.2679999999999998},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Sep 28 00:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":6.1509999999999998,"5min":6.1509999999999998,"15min":6.1509999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Sep 28 00:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Sep 28 00:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":6.2370000000000001,"5min":6.2370000000000001,"15min":6.2370000000000001},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8152,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363688,"statfs":{"total":96636764160,"available":96628416512,"internally_reserved":0,"allocated":278528,"data_stored":105918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.53500000000000003}]},{"osd":5,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56899999999999995}]},{"osd":6,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Sep 28 00:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64700000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542168,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8168,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363672,"statfs":{"total":96636764160,"available":96628400128,"internally_reserved":0,"allocated":294912,"data_stored":107420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.505}]},{"osd":1,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.495}]},{"osd":3,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.42799999999999999}]},{"osd":5,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.40899999999999997}]},{"osd":7,"last update":"Thu Sep 28 00:16:16 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-28T00:16:53.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-28T00:16:53.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.157+0000 7f1a874b2700 1 Processor -- start 2023-09-28T00:16:53.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.157+0000 7f1a874b2700 1 -- start start 2023-09-28T00:16:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.158+0000 7f1a874b2700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1a80159500 0x7f1a801598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.158+0000 7f1a874b2700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1a800b3fd0 0x7f1a8015d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.158+0000 7f1a874b2700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8015dd20 con 0x7f1a8015d8e0 2023-09-28T00:16:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.158+0000 7f1a874b2700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a800b1110 con 0x7f1a800b3fd0 2023-09-28T00:16:53.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.158+0000 7f1a874b2700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a800b13b0 con 0x7f1a80159500 2023-09-28T00:16:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.158+0000 7f1a84a4d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1a800b3fd0 0x7f1a8015d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.158+0000 7f1a84a4d700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1a800b3fd0 0x7f1a8015d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42330/0 (socket says 172.21.15.26:42330) 2023-09-28T00:16:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.158+0000 7f1a84a4d700 1 -- 172.21.15.26:0/3196929560 learned_addr learned my addr 172.21.15.26:0/3196929560 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a8524e700 1 --2- 172.21.15.26:0/3196929560 >> v2:172.21.15.190:3300/0 conn(0x7f1a80159500 0x7f1a801598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a84a4d700 1 -- 172.21.15.26:0/3196929560 >> v2:172.21.15.190:3300/0 conn(0x7f1a80159500 msgr2=0x7f1a801598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a84a4d700 1 --2- 172.21.15.26:0/3196929560 >> v2:172.21.15.190:3300/0 conn(0x7f1a80159500 0x7f1a801598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a84a4d700 1 -- 172.21.15.26:0/3196929560 >> v1:172.21.15.190:6789/0 conn(0x7f1a8015d8e0 legacy=0x7f1a800cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a84a4d700 1 -- 172.21.15.26:0/3196929560 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a800b1690 con 0x7f1a800b3fd0 2023-09-28T00:16:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a8524e700 1 --2- 172.21.15.26:0/3196929560 >> v2:172.21.15.190:3300/0 conn(0x7f1a80159500 0x7f1a801598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:16:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a84a4d700 1 --2- 172.21.15.26:0/3196929560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a800b3fd0 0x7f1a8015d3a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a80063e00 tx=0x7f1a74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c916d930d35974 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a7ffff700 1 -- 172.21.15.26:0/3196929560 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400b820 con 0x7f1a800b3fd0 2023-09-28T00:16:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a7ffff700 1 -- 172.21.15.26:0/3196929560 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7400b980 con 0x7f1a800b3fd0 2023-09-28T00:16:53.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a7ffff700 1 -- 172.21.15.26:0/3196929560 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7400bd20 con 0x7f1a800b3fd0 2023-09-28T00:16:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a874b2700 1 -- 172.21.15.26:0/3196929560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a800b3fd0 msgr2=0x7f1a8015d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a874b2700 1 --2- 172.21.15.26:0/3196929560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a800b3fd0 0x7f1a8015d3a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1a80063e00 tx=0x7f1a74009250 comp rx=0 tx=0).stop 2023-09-28T00:16:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a874b2700 1 -- 172.21.15.26:0/3196929560 shutdown_connections 2023-09-28T00:16:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a874b2700 1 --2- 172.21.15.26:0/3196929560 >> v2:172.21.15.190:3300/0 conn(0x7f1a80159500 0x7f1a801598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a874b2700 1 --2- 172.21.15.26:0/3196929560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a800b3fd0 0x7f1a8015d3a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.159+0000 7f1a874b2700 1 -- 172.21.15.26:0/3196929560 >> 172.21.15.26:0/3196929560 conn(0x7f1a80067630 msgr2=0x7f1a80069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:53.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.160+0000 7f1a874b2700 1 -- 172.21.15.26:0/3196929560 shutdown_connections 2023-09-28T00:16:53.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.160+0000 7f1a874b2700 1 -- 172.21.15.26:0/3196929560 wait complete. 2023-09-28T00:16:53.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.161+0000 7f1a874b2700 1 Processor -- start 2023-09-28T00:16:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.161+0000 7f1a874b2700 1 -- start start 2023-09-28T00:16:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a874b2700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a800b3fd0 0x7f1a800b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a874b2700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a80159500 0x7f1a8016a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a874b2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a8015d8e0 0x7f1a8013cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a874b2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8016d8f0 con 0x7f1a8015d8e0 2023-09-28T00:16:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a874b2700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8016deb0 con 0x7f1a800b3fd0 2023-09-28T00:16:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a874b2700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8016adb0 con 0x7f1a80159500 2023-09-28T00:16:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a85a4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a8015d8e0 0x7f1a8013cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a85a4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a8015d8e0 0x7f1a8013cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42338/0 (socket says 172.21.15.26:42338) 2023-09-28T00:16:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a85a4f700 1 -- 172.21.15.26:0/4095181024 learned_addr learned my addr 172.21.15.26:0/4095181024 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a8524e700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a800b3fd0 0x7f1a800b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a84a4d700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a80159500 0x7f1a8016a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a85a4f700 1 -- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a80159500 msgr2=0x7f1a8016a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a85a4f700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a80159500 0x7f1a8016a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a85a4f700 1 -- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a800b3fd0 msgr2=0x7f1a800b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a85a4f700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a800b3fd0 0x7f1a800b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a85a4f700 1 -- 172.21.15.26:0/4095181024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740094f0 con 0x7f1a8015d8e0 2023-09-28T00:16:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a85a4f700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a8015d8e0 0x7f1a8013cc80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000bc30 tx=0x7f1a70009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a7d7fa700 1 -- 172.21.15.26:0/4095181024 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000c840 con 0x7f1a8015d8e0 2023-09-28T00:16:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a7d7fa700 1 -- 172.21.15.26:0/4095181024 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000c9e0 con 0x7f1a8015d8e0 2023-09-28T00:16:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.162+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8016b0f0 con 0x7f1a8015d8e0 2023-09-28T00:16:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.163+0000 7f1a7d7fa700 1 -- 172.21.15.26:0/4095181024 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000cda0 con 0x7f1a8015d8e0 2023-09-28T00:16:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.163+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a800b24c0 con 0x7f1a8015d8e0 2023-09-28T00:16:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.163+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a800b26e0 con 0x7f1a8015d8e0 2023-09-28T00:16:53.171 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.164+0000 7f1a7d7fa700 1 -- 172.21.15.26:0/4095181024 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f1a70014620 con 0x7f1a8015d8e0 2023-09-28T00:16:53.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.164+0000 7f1a7d7fa700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1a6c067330 0x7f1a6c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.164+0000 7f1a7d7fa700 1 -- 172.21.15.26:0/4095181024 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1a70084b50 con 0x7f1a8015d8e0 2023-09-28T00:16:53.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.164+0000 7f1a8524e700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1a6c067330 0x7f1a6c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.172 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.165+0000 7f1a8524e700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1a6c067330 0x7f1a6c0697e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a80157d80 tx=0x7f1a78006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:53.173 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.168+0000 7f1a7d7fa700 1 -- 172.21.15.26:0/4095181024 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f1a70051a10 con 0x7f1a8015d8e0 2023-09-28T00:16:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.362+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1a80064050 con 0x7f1a8015d8e0 2023-09-28T00:16:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.366+0000 7f1a7d7fa700 1 -- 172.21.15.26:0/4095181024 <== mon.0 v2:172.21.15.26:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1a70051a10 con 0x7f1a8015d8e0 2023-09-28T00:16:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.366+0000 7f1a7d7fa700 1 -- 172.21.15.26:0/4095181024 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1a70055030 con 0x7f1a8015d8e0 2023-09-28T00:16:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1a6c067330 msgr2=0x7f1a6c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1a6c067330 0x7f1a6c0697e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a80157d80 tx=0x7f1a78006f90 comp rx=0 tx=0).stop 2023-09-28T00:16:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a8015d8e0 msgr2=0x7f1a8013cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a8015d8e0 0x7f1a8013cc80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000bc30 tx=0x7f1a70009820 comp rx=0 tx=0).stop 2023-09-28T00:16:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 shutdown_connections 2023-09-28T00:16:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f1a6c067330 0x7f1a6c0697e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a8015d8e0 0x7f1a8013cc80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a800b3fd0 0x7f1a800b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 --2- 172.21.15.26:0/4095181024 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a80159500 0x7f1a8016a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 >> 172.21.15.26:0/4095181024 conn(0x7f1a80067630 msgr2=0x7f1a800cf470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 shutdown_connections 2023-09-28T00:16:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.368+0000 7f1a874b2700 1 -- 172.21.15.26:0/4095181024 wait complete. 2023-09-28T00:16:53.381 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-28T00:16:53.381 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:16:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.498+0000 7fe622319700 1 Processor -- start 2023-09-28T00:16:53.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.498+0000 7fe622319700 1 -- start start 2023-09-28T00:16:53.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.499+0000 7fe622319700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe61c15d480 0x7fe61c069860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.499+0000 7fe622319700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c0687c0 con 0x7fe61c069da0 2023-09-28T00:16:53.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.499+0000 7fe622319700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c068aa0 con 0x7fe61c0b0a20 2023-09-28T00:16:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.499+0000 7fe622319700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c068d80 con 0x7fe61c15d480 2023-09-28T00:16:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.499+0000 7fe620b16700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe61c069da0 0x7fe61c0b0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35636/0 (socket says 172.21.15.26:35636) 2023-09-28T00:16:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.499+0000 7fe620b16700 1 -- 172.21.15.26:0/3318780121 learned_addr learned my addr 172.21.15.26:0/3318780121 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:16:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.499+0000 7fe621317700 1 --2- 172.21.15.26:0/3318780121 >> v2:172.21.15.190:3300/0 conn(0x7fe61c15d480 0x7fe61c069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.499+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958702803 0 0) 0x7fe61c0687c0 con 0x7fe61c069da0 2023-09-28T00:16:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.499+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe604003570 con 0x7fe61c069da0 2023-09-28T00:16:53.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620788220 0 0) 0x7fe604003570 con 0x7fe61c069da0 2023-09-28T00:16:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 >> v2:172.21.15.190:3300/0 conn(0x7fe61c15d480 msgr2=0x7fe61c069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 --2- 172.21.15.26:0/3318780121 >> v2:172.21.15.190:3300/0 conn(0x7fe61c15d480 0x7fe61c069860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 >> v1:172.21.15.190:6789/0 conn(0x7fe61c0b0a20 legacy=0x7fe61c0b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c069060 con 0x7fe61c069da0 2023-09-28T00:16:53.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fe610001470 con 0x7fe61c069da0 2023-09-28T00:16:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 >> v1:172.21.15.26:6789/0 conn(0x7fe61c069da0 legacy=0x7fe61c0b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe604003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe604004810 0x7fe604004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6040051c0 0x7fe60400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c068d80 con 0x7fe604003a60 2023-09-28T00:16:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60400c160 con 0x7fe6040051c0 2023-09-28T00:16:53.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60400c320 con 0x7fe604004810 2023-09-28T00:16:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe621317700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe604003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe620b16700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe604004810 0x7fe604004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe621b18700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6040051c0 0x7fe60400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe621317700 1 -- 172.21.15.26:0/3318780121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe604004810 msgr2=0x7fe604004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe621317700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe604004810 0x7fe604004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe621317700 1 -- 172.21.15.26:0/3318780121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6040051c0 msgr2=0x7fe60400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:53.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe621317700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe6040051c0 0x7fe60400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe621b18700 1 -- 172.21.15.26:0/3318780121 reap_dead start 2023-09-28T00:16:53.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe621317700 1 -- 172.21.15.26:0/3318780121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe604003570 con 0x7fe604003a60 2023-09-28T00:16:53.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe620b16700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe604004810 0x7fe604004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-28T00:16:53.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe621317700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe604003e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe614009c00 tx=0x7fe6140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b7c19cbb32ec9 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:53.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400e710 con 0x7fe604003a60 2023-09-28T00:16:53.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe61400e870 con 0x7fe604003a60 2023-09-28T00:16:53.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.500+0000 7fe61bfff700 1 -- 172.21.15.26:0/3318780121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400ec50 con 0x7fe604003a60 2023-09-28T00:16:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.501+0000 7fe622319700 1 -- 172.21.15.26:0/3318780121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 msgr2=0x7fe604003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.501+0000 7fe622319700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe604003e70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe614009c00 tx=0x7fe6140091a0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.501+0000 7fe622319700 1 -- 172.21.15.26:0/3318780121 shutdown_connections 2023-09-28T00:16:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.501+0000 7fe622319700 1 --2- 172.21.15.26:0/3318780121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe604003e70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.501+0000 7fe622319700 1 -- 172.21.15.26:0/3318780121 >> 172.21.15.26:0/3318780121 conn(0x7fe61c0ccf80 msgr2=0x7fe61c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.501+0000 7fe622319700 1 -- 172.21.15.26:0/3318780121 shutdown_connections 2023-09-28T00:16:53.509 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.501+0000 7fe622319700 1 -- 172.21.15.26:0/3318780121 wait complete. 2023-09-28T00:16:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.502+0000 7fe622319700 1 Processor -- start 2023-09-28T00:16:53.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.502+0000 7fe622319700 1 -- start start 2023-09-28T00:16:53.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe622319700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe61c16a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe622319700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0c6c70 0x7fe61c0ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe622319700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0c70e0 0x7fe61c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe622319700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c16b140 con 0x7fe604003a60 2023-09-28T00:16:53.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe622319700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c13fa20 con 0x7fe61c0c70e0 2023-09-28T00:16:53.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe622319700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c16c0f0 con 0x7fe61c0c6c70 2023-09-28T00:16:53.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621317700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe61c16a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621317700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe61c16a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42358/0 (socket says 172.21.15.26:42358) 2023-09-28T00:16:53.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621317700 1 -- 172.21.15.26:0/1144589905 learned_addr learned my addr 172.21.15.26:0/1144589905 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:53.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621b18700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0c70e0 0x7fe61c0cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621317700 1 -- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0c6c70 msgr2=0x7fe61c0ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe620b16700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0c6c70 0x7fe61c0ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621317700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0c6c70 0x7fe61c0ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621317700 1 -- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0c70e0 msgr2=0x7fe61c0cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621317700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0c70e0 0x7fe61c0cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621317700 1 -- 172.21.15.26:0/1144589905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c16b7c0 con 0x7fe604003a60 2023-09-28T00:16:53.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621b18700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0c70e0 0x7fe61c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:16:53.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe620b16700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0c6c70 0x7fe61c0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-28T00:16:53.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.503+0000 7fe621317700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe61c16a8c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe614000e10 tx=0x7fe6140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:53.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.504+0000 7fe6197fa700 1 -- 172.21.15.26:0/1144589905 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614022070 con 0x7fe604003a60 2023-09-28T00:16:53.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.504+0000 7fe6197fa700 1 -- 172.21.15.26:0/1144589905 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe614013cc0 con 0x7fe604003a60 2023-09-28T00:16:53.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.504+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c16baa0 con 0x7fe604003a60 2023-09-28T00:16:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.504+0000 7fe6197fa700 1 -- 172.21.15.26:0/1144589905 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400e710 con 0x7fe604003a60 2023-09-28T00:16:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.504+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c16ae00 con 0x7fe604003a60 2023-09-28T00:16:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.505+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c04c3c0 con 0x7fe604003a60 2023-09-28T00:16:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.505+0000 7fe6197fa700 1 -- 172.21.15.26:0/1144589905 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fe61401c450 con 0x7fe604003a60 2023-09-28T00:16:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.505+0000 7fe6197fa700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe608067330 0x7fe6080697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.505+0000 7fe6197fa700 1 -- 172.21.15.26:0/1144589905 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe614086680 con 0x7fe604003a60 2023-09-28T00:16:53.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.506+0000 7fe620b16700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe608067330 0x7fe6080697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.506+0000 7fe620b16700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe608067330 0x7fe6080697e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe610000fd0 tx=0x7fe610000f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:53.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.510+0000 7fe6197fa700 1 -- 172.21.15.26:0/1144589905 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fe614053680 con 0x7fe604003a60 2023-09-28T00:16:53.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.744+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe61c069340 con 0x7fe604003a60 2023-09-28T00:16:53.746 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.745+0000 7fe6197fa700 1 -- 172.21.15.26:0/1144589905 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fe614056be0 con 0x7fe604003a60 2023-09-28T00:16:53.746 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:16:53.746 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1101672577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1101672577},{"type":"v1","addr":"172.21.15.190:6836","nonce":1101672577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3243251915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3243251915},{"type":"v1","addr":"172.21.15.26:6834","nonce":3243251915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/501056069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":501056069},{"type":"v1","addr":"172.21.15.26:6835","nonce":501056069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:15:29.372185+0000","modified":"2023-09-28T00:15:32.384937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/3098279304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3098279304},{"type":"v1","addr":"172.21.15.190:6837","nonce":3098279304}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:16:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe608067330 msgr2=0x7fe6080697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe608067330 0x7fe6080697e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe610000fd0 tx=0x7fe610000f60 comp rx=0 tx=0).stop 2023-09-28T00:16:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 msgr2=0x7fe61c16a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe61c16a8c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe614000e10 tx=0x7fe6140091a0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 shutdown_connections 2023-09-28T00:16:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fe608067330 0x7fe6080697e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe61c0c70e0 0x7fe61c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe604003a60 0x7fe61c16a8c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 --2- 172.21.15.26:0/1144589905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe61c0c6c70 0x7fe61c0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 >> 172.21.15.26:0/1144589905 conn(0x7fe61c0ccf80 msgr2=0x7fe61c141510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:53.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 shutdown_connections 2023-09-28T00:16:53.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.747+0000 7fe622319700 1 -- 172.21.15.26:0/1144589905 wait complete. 2023-09-28T00:16:53.750 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-09-28T00:16:53.760 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-28T00:16:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.878+0000 7fd95ac0d700 1 Processor -- start 2023-09-28T00:16:53.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.878+0000 7fd95ac0d700 1 -- start start 2023-09-28T00:16:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.879+0000 7fd95ac0d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954153f70 0x7fd9540b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.879+0000 7fd95ac0d700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95415a5e0 con 0x7fd954153ba0 2023-09-28T00:16:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.879+0000 7fd95ac0d700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95415a8c0 con 0x7fd9540ad4d0 2023-09-28T00:16:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.879+0000 7fd95ac0d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95415aba0 con 0x7fd954153f70 2023-09-28T00:16:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.879+0000 7fd959c0b700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd954153ba0 0x7fd954159d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35642/0 (socket says 172.21.15.26:35642) 2023-09-28T00:16:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.879+0000 7fd959c0b700 1 -- 172.21.15.26:0/4116280810 learned_addr learned my addr 172.21.15.26:0/4116280810 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:16:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.879+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113999462 0 0) 0x7fd95415a5e0 con 0x7fd954153ba0 2023-09-28T00:16:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.879+0000 7fd95940a700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954153f70 0x7fd9540b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.879+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd93c003570 con 0x7fd954153ba0 2023-09-28T00:16:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 174700878 0 0) 0x7fd93c003570 con 0x7fd954153ba0 2023-09-28T00:16:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954153f70 msgr2=0x7fd9540b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954153f70 0x7fd9540b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 >> v1:172.21.15.190:6789/0 conn(0x7fd9540ad4d0 legacy=0x7fd9540ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9540accd0 con 0x7fd954153ba0 2023-09-28T00:16:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3569433013 0 0) 0x7fd94c0015f0 con 0x7fd954153ba0 2023-09-28T00:16:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 >> v1:172.21.15.26:6789/0 conn(0x7fd954153ba0 legacy=0x7fd954159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954153f70 0x7fd93c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c004010 0x7fd93c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c004d50 0x7fd93c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95415aba0 con 0x7fd93c004010 2023-09-28T00:16:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c00bbf0 con 0x7fd93c004d50 2023-09-28T00:16:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c00bdb0 con 0x7fd954153f70 2023-09-28T00:16:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd95940a700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c004010 0x7fd93c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd959c0b700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954153f70 0x7fd93c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd95a40c700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c004d50 0x7fd93c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd95940a700 1 -- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954153f70 msgr2=0x7fd93c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd95940a700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954153f70 0x7fd93c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd95940a700 1 -- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c004d50 msgr2=0x7fd93c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd95940a700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c004d50 0x7fd93c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd95940a700 1 -- 172.21.15.26:0/4116280810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c003570 con 0x7fd93c004010 2023-09-28T00:16:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.880+0000 7fd95940a700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c004010 0x7fd93c004810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd948006f00 tx=0x7fd9480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29eece2e5289d19b server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800e6e0 con 0x7fd93c004010 2023-09-28T00:16:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd94800e840 con 0x7fd93c004010 2023-09-28T00:16:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd958c09700 1 -- 172.21.15.26:0/4116280810 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800ec20 con 0x7fd93c004010 2023-09-28T00:16:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd95ac0d700 1 -- 172.21.15.26:0/4116280810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c004010 msgr2=0x7fd93c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd95ac0d700 1 --2- 172.21.15.26:0/4116280810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c004010 0x7fd93c004810 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd948006f00 tx=0x7fd9480091a0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd95a40c700 1 -- 172.21.15.26:0/4116280810 reap_dead start 2023-09-28T00:16:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd95ac0d700 1 -- 172.21.15.26:0/4116280810 shutdown_connections 2023-09-28T00:16:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd95ac0d700 1 -- 172.21.15.26:0/4116280810 >> 172.21.15.26:0/4116280810 conn(0x7fd95406e600 msgr2=0x7fd95406afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd95ac0d700 1 -- 172.21.15.26:0/4116280810 shutdown_connections 2023-09-28T00:16:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.881+0000 7fd95ac0d700 1 -- 172.21.15.26:0/4116280810 wait complete. 2023-09-28T00:16:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.882+0000 7fd95ac0d700 1 Processor -- start 2023-09-28T00:16:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.882+0000 7fd95ac0d700 1 -- start start 2023-09-28T00:16:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95ac0d700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c004010 0x7fd954151270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95ac0d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95406aa70 0x7fd95406aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95ac0d700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954169bb0 0x7fd95416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95ac0d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95406b420 con 0x7fd95406aa70 2023-09-28T00:16:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95ac0d700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95416abc0 con 0x7fd93c004010 2023-09-28T00:16:53.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95ac0d700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9541517b0 con 0x7fd954169bb0 2023-09-28T00:16:53.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95940a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95406aa70 0x7fd95406aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95940a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95406aa70 0x7fd95406aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42388/0 (socket says 172.21.15.26:42388) 2023-09-28T00:16:53.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd959c0b700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c004010 0x7fd954151270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95940a700 1 -- 172.21.15.26:0/2997984019 learned_addr learned my addr 172.21.15.26:0/2997984019 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:53.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.883+0000 7fd95a40c700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954169bb0 0x7fd95416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.892 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd95940a700 1 -- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954169bb0 msgr2=0x7fd95416a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd95940a700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954169bb0 0x7fd95416a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd95940a700 1 -- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c004010 msgr2=0x7fd954151270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd95940a700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c004010 0x7fd954151270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd95940a700 1 -- 172.21.15.26:0/2997984019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95416a8e0 con 0x7fd95406aa70 2023-09-28T00:16:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd95940a700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95406aa70 0x7fd95406aee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd9541543a0 tx=0x7fd9480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd951ffb700 1 -- 172.21.15.26:0/2997984019 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd948022070 con 0x7fd95406aa70 2023-09-28T00:16:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd951ffb700 1 -- 172.21.15.26:0/2997984019 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd948013c50 con 0x7fd95406aa70 2023-09-28T00:16:53.893 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd951ffb700 1 -- 172.21.15.26:0/2997984019 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94800e6e0 con 0x7fd95406aa70 2023-09-28T00:16:53.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95416aef0 con 0x7fd95406aa70 2023-09-28T00:16:53.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.884+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95416b4b0 con 0x7fd95406aa70 2023-09-28T00:16:53.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.885+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95404c3c0 con 0x7fd95406aa70 2023-09-28T00:16:53.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.885+0000 7fd951ffb700 1 -- 172.21.15.26:0/2997984019 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fd94801c660 con 0x7fd95406aa70 2023-09-28T00:16:53.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.886+0000 7fd951ffb700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd940067330 0x7fd9400697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:53.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.886+0000 7fd951ffb700 1 -- 172.21.15.26:0/2997984019 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd9480861b0 con 0x7fd95406aa70 2023-09-28T00:16:53.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.886+0000 7fd959c0b700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd940067330 0x7fd9400697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:53.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.886+0000 7fd959c0b700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd940067330 0x7fd9400697e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd9540b12e0 tx=0x7fd94c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:53.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:53.890+0000 7fd951ffb700 1 -- 172.21.15.26:0/2997984019 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fd948053260 con 0x7fd95406aa70 2023-09-28T00:16:54.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.130+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd95415bb50 con 0x7fd95406aa70 2023-09-28T00:16:54.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.131+0000 7fd951ffb700 1 -- 172.21.15.26:0/2997984019 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fd948056880 con 0x7fd95406aa70 2023-09-28T00:16:54.132 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:16:54.133 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6836/1101672577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":1101672577},{"type":"v1","addr":"172.21.15.190:6836","nonce":1101672577}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6834/3243251915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3243251915},{"type":"v1","addr":"172.21.15.26:6834","nonce":3243251915}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/501056069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6833","nonce":501056069},{"type":"v1","addr":"172.21.15.26:6835","nonce":501056069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-28T00:15:29.372185+0000","modified":"2023-09-28T00:15:32.384937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.190:6837/3098279304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":3098279304},{"type":"v1","addr":"172.21.15.190:6837","nonce":3098279304}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-28T00:16:54.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd940067330 msgr2=0x7fd9400697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd940067330 0x7fd9400697e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd9540b12e0 tx=0x7fd94c009040 comp rx=0 tx=0).stop 2023-09-28T00:16:54.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95406aa70 msgr2=0x7fd95406aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95406aa70 0x7fd95406aee0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd9541543a0 tx=0x7fd9480091a0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 shutdown_connections 2023-09-28T00:16:54.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fd940067330 0x7fd9400697e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd954169bb0 0x7fd95416a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c004010 0x7fd954151270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 --2- 172.21.15.26:0/2997984019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd95406aa70 0x7fd95406aee0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 >> 172.21.15.26:0/2997984019 conn(0x7fd95406e600 msgr2=0x7fd95415adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 shutdown_connections 2023-09-28T00:16:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.133+0000 7fd95ac0d700 1 -- 172.21.15.26:0/2997984019 wait complete. 2023-09-28T00:16:54.136 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-09-28T00:16:54.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-28T00:16:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.265+0000 7fc110155700 1 Processor -- start 2023-09-28T00:16:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.265+0000 7fc110155700 1 -- start start 2023-09-28T00:16:54.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc110155700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc10815d930 0x7fc1080d0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc110155700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1081591b0 0x7fc108159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc110155700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1080b2ad0 con 0x7fc10815d560 2023-09-28T00:16:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc110155700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1080b4160 con 0x7fc10815d930 2023-09-28T00:16:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc110155700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc108159b70 con 0x7fc1081591b0 2023-09-28T00:16:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10d6f0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc10815d930 0x7fc1080d0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10d6f0700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc10815d930 0x7fc1080d0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42404/0 (socket says 172.21.15.26:42404) 2023-09-28T00:16:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10d6f0700 1 -- 172.21.15.26:0/384981661 learned_addr learned my addr 172.21.15.26:0/384981661 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:54.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10e6f2700 1 --2- 172.21.15.26:0/384981661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1081591b0 0x7fc108159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10d6f0700 1 -- 172.21.15.26:0/384981661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1081591b0 msgr2=0x7fc108159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:54.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10d6f0700 1 --2- 172.21.15.26:0/384981661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1081591b0 0x7fc108159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10d6f0700 1 -- 172.21.15.26:0/384981661 >> v1:172.21.15.190:6789/0 conn(0x7fc10815d560 legacy=0x7fc1080b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10d6f0700 1 -- 172.21.15.26:0/384981661 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080b2230 con 0x7fc10815d930 2023-09-28T00:16:54.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10d6f0700 1 --2- 172.21.15.26:0/384981661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d930 0x7fc1080d0030 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80099b0 tx=0x7fc0f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565495023cb4b960 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:54.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.266+0000 7fc10ceef700 1 -- 172.21.15.26:0/384981661 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8009ea0 con 0x7fc10815d930 2023-09-28T00:16:54.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc10ceef700 1 -- 172.21.15.26:0/384981661 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc0f800b860 con 0x7fc10815d930 2023-09-28T00:16:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc10ceef700 1 -- 172.21.15.26:0/384981661 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800bc20 con 0x7fc10815d930 2023-09-28T00:16:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc110155700 1 -- 172.21.15.26:0/384981661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d930 msgr2=0x7fc1080d0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc110155700 1 --2- 172.21.15.26:0/384981661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d930 0x7fc1080d0030 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc0f80099b0 tx=0x7fc0f8009250 comp rx=0 tx=0).stop 2023-09-28T00:16:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc110155700 1 -- 172.21.15.26:0/384981661 shutdown_connections 2023-09-28T00:16:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc110155700 1 --2- 172.21.15.26:0/384981661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc1081591b0 0x7fc108159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc110155700 1 --2- 172.21.15.26:0/384981661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d930 0x7fc1080d0030 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc110155700 1 -- 172.21.15.26:0/384981661 >> 172.21.15.26:0/384981661 conn(0x7fc1080d1180 msgr2=0x7fc108069640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:54.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc110155700 1 -- 172.21.15.26:0/384981661 shutdown_connections 2023-09-28T00:16:54.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.267+0000 7fc110155700 1 -- 172.21.15.26:0/384981661 wait complete. 2023-09-28T00:16:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.268+0000 7fc110155700 1 Processor -- start 2023-09-28T00:16:54.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.268+0000 7fc110155700 1 -- start start 2023-09-28T00:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc110155700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1081591b0 0x7fc1080c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc110155700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d560 0x7fc1080c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc110155700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc10815d930 0x7fc1080ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc110155700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080c8d80 con 0x7fc10815d560 2023-09-28T00:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc110155700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080c8170 con 0x7fc1081591b0 2023-09-28T00:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc110155700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080c8450 con 0x7fc10815d930 2023-09-28T00:16:54.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10d6f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d560 0x7fc1080c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10d6f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d560 0x7fc1080c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42412/0 (socket says 172.21.15.26:42412) 2023-09-28T00:16:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10d6f0700 1 -- 172.21.15.26:0/1975220613 learned_addr learned my addr 172.21.15.26:0/1975220613 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10def1700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1081591b0 0x7fc1080c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10e6f2700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc10815d930 0x7fc1080ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10d6f0700 1 -- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc10815d930 msgr2=0x7fc1080ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10d6f0700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc10815d930 0x7fc1080ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10d6f0700 1 -- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1081591b0 msgr2=0x7fc1080c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10d6f0700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1081591b0 0x7fc1080c9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.269+0000 7fc10d6f0700 1 -- 172.21.15.26:0/1975220613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80094f0 con 0x7fc10815d560 2023-09-28T00:16:54.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.270+0000 7fc10d6f0700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d560 0x7fc1080c69a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc108064a20 tx=0x7fc0f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:54.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.270+0000 7fc0fdffb700 1 -- 172.21.15.26:0/1975220613 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800bbe0 con 0x7fc10815d560 2023-09-28T00:16:54.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.270+0000 7fc0fdffb700 1 -- 172.21.15.26:0/1975220613 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc0f8011420 con 0x7fc10815d560 2023-09-28T00:16:54.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.270+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1080c8730 con 0x7fc10815d560 2023-09-28T00:16:54.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.270+0000 7fc0fdffb700 1 -- 172.21.15.26:0/1975220613 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8011800 con 0x7fc10815d560 2023-09-28T00:16:54.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.270+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1080c6ee0 con 0x7fc10815d560 2023-09-28T00:16:54.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.271+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1080c9750 con 0x7fc10815d560 2023-09-28T00:16:54.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.271+0000 7fc0fdffb700 1 -- 172.21.15.26:0/1975220613 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fc0f8011b70 con 0x7fc10815d560 2023-09-28T00:16:54.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.272+0000 7fc0fdffb700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc0ec067330 0x7fc0ec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.272+0000 7fc0fdffb700 1 -- 172.21.15.26:0/1975220613 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fc0f8086360 con 0x7fc10815d560 2023-09-28T00:16:54.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.272+0000 7fc10def1700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc0ec067330 0x7fc0ec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.272+0000 7fc10def1700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc0ec067330 0x7fc0ec0697e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc104003860 tx=0x7fc104009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:54.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.276+0000 7fc0fdffb700 1 -- 172.21.15.26:0/1975220613 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fc0f80532a0 con 0x7fc10815d560 2023-09-28T00:16:54.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.471+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc108064050 con 0x7fc10815d560 2023-09-28T00:16:54.473 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.472+0000 7fc0fdffb700 1 -- 172.21.15.26:0/1975220613 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+16961 (secure 0 0 0) 0x7fc0f80568c0 con 0x7fc10815d560 2023-09-28T00:16:54.473 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-09-28T00:16:54.473 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8f4ad52c-4a7b-4e1e-9aae-0d1a0f4ddaa6","created":"2023-09-28T00:15:04.039783+0000","modified":"2023-09-28T00:16:11.015552+0000","last_up_change":"2023-09-28T00:15:14.866905+0000","last_in_change":"2023-09-28T00:15:06.439998+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-28T00:15:15.721561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-28T00:15:22.381112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-28T00:15:27.106757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-28T00:15:28.347923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ae80c2eb-fc4b-4bb6-b419-bb5de9cf80c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":90241},{"type":"v1","addr":"172.21.15.26:6817","nonce":90241}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":90241},{"type":"v1","addr":"172.21.15.26:6819","nonce":90241}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":90241},{"type":"v1","addr":"172.21.15.26:6823","nonce":90241}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":90241},{"type":"v1","addr":"172.21.15.26:6821","nonce":90241}]},"public_addr":"172.21.15.26:6817/90241","cluster_addr":"172.21.15.26:6819/90241","heartbeat_back_addr":"172.21.15.26:6823/90241","heartbeat_front_addr":"172.21.15.26:6821/90241","state":["exists","up"]},{"osd":1,"uuid":"ed631803-d97e-4de7-9e2e-789319144458","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":90239},{"type":"v1","addr":"172.21.15.26:6809","nonce":90239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":90239},{"type":"v1","addr":"172.21.15.26:6811","nonce":90239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":90239},{"type":"v1","addr":"172.21.15.26:6815","nonce":90239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":90239},{"type":"v1","addr":"172.21.15.26:6813","nonce":90239}]},"public_addr":"172.21.15.26:6809/90239","cluster_addr":"172.21.15.26:6811/90239","heartbeat_back_addr":"172.21.15.26:6815/90239","heartbeat_front_addr":"172.21.15.26:6813/90239","state":["exists","up"]},{"osd":2,"uuid":"c20af5a6-8a13-4cf2-b6ca-de79e551bb42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":90240},{"type":"v1","addr":"172.21.15.26:6801","nonce":90240}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":90240},{"type":"v1","addr":"172.21.15.26:6803","nonce":90240}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":90240},{"type":"v1","addr":"172.21.15.26:6807","nonce":90240}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":90240},{"type":"v1","addr":"172.21.15.26:6805","nonce":90240}]},"public_addr":"172.21.15.26:6801/90240","cluster_addr":"172.21.15.26:6803/90240","heartbeat_back_addr":"172.21.15.26:6807/90240","heartbeat_front_addr":"172.21.15.26:6805/90240","state":["exists","up"]},{"osd":3,"uuid":"981d7b91-506e-4842-a2b4-a1ca4ec0376d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":90242},{"type":"v1","addr":"172.21.15.26:6825","nonce":90242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":90242},{"type":"v1","addr":"172.21.15.26:6827","nonce":90242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":90242},{"type":"v1","addr":"172.21.15.26:6831","nonce":90242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":90242},{"type":"v1","addr":"172.21.15.26:6829","nonce":90242}]},"public_addr":"172.21.15.26:6825/90242","cluster_addr":"172.21.15.26:6827/90242","heartbeat_back_addr":"172.21.15.26:6831/90242","heartbeat_front_addr":"172.21.15.26:6829/90242","state":["exists","up"]},{"osd":4,"uuid":"52e8958b-cf61-4e15-9d61-3fbe25e70638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":90454},{"type":"v1","addr":"172.21.15.190:6801","nonce":90454}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":90454},{"type":"v1","addr":"172.21.15.190:6803","nonce":90454}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":90454},{"type":"v1","addr":"172.21.15.190:6807","nonce":90454}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":90454},{"type":"v1","addr":"172.21.15.190:6805","nonce":90454}]},"public_addr":"172.21.15.190:6801/90454","cluster_addr":"172.21.15.190:6803/90454","heartbeat_back_addr":"172.21.15.190:6807/90454","heartbeat_front_addr":"172.21.15.190:6805/90454","state":["exists","up"]},{"osd":5,"uuid":"db77a77e-0529-4dcf-b72a-04f5023122cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":90467},{"type":"v1","addr":"172.21.15.190:6817","nonce":90467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6818","nonce":90467},{"type":"v1","addr":"172.21.15.190:6819","nonce":90467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6822","nonce":90467},{"type":"v1","addr":"172.21.15.190:6824","nonce":90467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":90467},{"type":"v1","addr":"172.21.15.190:6821","nonce":90467}]},"public_addr":"172.21.15.190:6817/90467","cluster_addr":"172.21.15.190:6819/90467","heartbeat_back_addr":"172.21.15.190:6824/90467","heartbeat_front_addr":"172.21.15.190:6821/90467","state":["exists","up"]},{"osd":6,"uuid":"4020afcb-34e5-4f45-a65e-b59ded668f59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6823","nonce":90456},{"type":"v1","addr":"172.21.15.190:6825","nonce":90456}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6826","nonce":90456},{"type":"v1","addr":"172.21.15.190:6827","nonce":90456}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6830","nonce":90456},{"type":"v1","addr":"172.21.15.190:6831","nonce":90456}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":90456},{"type":"v1","addr":"172.21.15.190:6829","nonce":90456}]},"public_addr":"172.21.15.190:6825/90456","cluster_addr":"172.21.15.190:6827/90456","heartbeat_back_addr":"172.21.15.190:6831/90456","heartbeat_front_addr":"172.21.15.190:6829/90456","state":["exists","up"]},{"osd":7,"uuid":"37bf7abd-1f52-435b-a5b1-2ca5626c540d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":90455},{"type":"v1","addr":"172.21.15.190:6809","nonce":90455}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":90455},{"type":"v1","addr":"172.21.15.190:6811","nonce":90455}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":90455},{"type":"v1","addr":"172.21.15.190:6815","nonce":90455}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":90455},{"type":"v1","addr":"172.21.15.190:6813","nonce":90455}]},"public_addr":"172.21.15.190:6809/90455","cluster_addr":"172.21.15.190:6811/90455","heartbeat_back_addr":"172.21.15.190:6815/90455","heartbeat_front_addr":"172.21.15.190:6813/90455","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.570252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.512072+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.119854+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.588867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.331113+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.548141+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.645805+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-28T00:15:11.565869+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":5}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-28T00:16:54.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc0ec067330 msgr2=0x7fc0ec0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc0ec067330 0x7fc0ec0697e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc104003860 tx=0x7fc104009040 comp rx=0 tx=0).stop 2023-09-28T00:16:54.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d560 msgr2=0x7fc1080c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d560 0x7fc1080c69a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc108064a20 tx=0x7fc0f8009250 comp rx=0 tx=0).stop 2023-09-28T00:16:54.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 shutdown_connections 2023-09-28T00:16:54.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fc0ec067330 0x7fc0ec0697e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc10815d930 0x7fc1080ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc1081591b0 0x7fc1080c9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 --2- 172.21.15.26:0/1975220613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10815d560 0x7fc1080c69a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 >> 172.21.15.26:0/1975220613 conn(0x7fc1080d1180 msgr2=0x7fc1080685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:54.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 shutdown_connections 2023-09-28T00:16:54.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.474+0000 7fc110155700 1 -- 172.21.15.26:0/1975220613 wait complete. 2023-09-28T00:16:54.487 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-28T00:16:54.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.605+0000 7fcbd9bb8700 1 Processor -- start 2023-09-28T00:16:54.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.606+0000 7fcbd9bb8700 1 -- start start 2023-09-28T00:16:54.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.606+0000 7fcbd9bb8700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcbd41598d0 0x7fcbd415d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.606+0000 7fcbd9bb8700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd415dd20 con 0x7fcbd415d8e0 2023-09-28T00:16:54.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.606+0000 7fcbd9bb8700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40b1110 con 0x7fcbd4159500 2023-09-28T00:16:54.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.606+0000 7fcbd9bb8700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd40b13b0 con 0x7fcbd41598d0 2023-09-28T00:16:54.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.606+0000 7fcbd2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcbd41598d0 0x7fcbd415d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.606+0000 7fcbd3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcbd415d8e0 0x7fcbd40cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35648/0 (socket says 172.21.15.26:35648) 2023-09-28T00:16:54.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.607+0000 7fcbd3fff700 1 -- 172.21.15.26:0/768485943 learned_addr learned my addr 172.21.15.26:0/768485943 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:16:54.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.607+0000 7fcbd2ffd700 1 -- 172.21.15.26:0/768485943 >> v1:172.21.15.190:6789/0 conn(0x7fcbd4159500 legacy=0x7fcbd40b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.607+0000 7fcbd2ffd700 1 -- 172.21.15.26:0/768485943 >> v1:172.21.15.26:6789/0 conn(0x7fcbd415d8e0 legacy=0x7fcbd40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.607+0000 7fcbd2ffd700 1 -- 172.21.15.26:0/768485943 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd40b1690 con 0x7fcbd41598d0 2023-09-28T00:16:54.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.607+0000 7fcbd2ffd700 1 --2- 172.21.15.26:0/768485943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd41598d0 0x7fcbd415d3a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80098e0 tx=0x7fcbc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8778d6cbfedad179 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:54.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.607+0000 7fcbd27fc700 1 -- 172.21.15.26:0/768485943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8009e80 con 0x7fcbd41598d0 2023-09-28T00:16:54.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.607+0000 7fcbd27fc700 1 -- 172.21.15.26:0/768485943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcbc800b760 con 0x7fcbd41598d0 2023-09-28T00:16:54.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.607+0000 7fcbd27fc700 1 -- 172.21.15.26:0/768485943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc800bb00 con 0x7fcbd41598d0 2023-09-28T00:16:54.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.608+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/768485943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd41598d0 msgr2=0x7fcbd415d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.608+0000 7fcbd9bb8700 1 --2- 172.21.15.26:0/768485943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd41598d0 0x7fcbd415d3a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80098e0 tx=0x7fcbc80091a0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.608+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/768485943 shutdown_connections 2023-09-28T00:16:54.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.608+0000 7fcbd9bb8700 1 --2- 172.21.15.26:0/768485943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd41598d0 0x7fcbd415d3a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.608+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/768485943 >> 172.21.15.26:0/768485943 conn(0x7fcbd4067630 msgr2=0x7fcbd4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.608+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/768485943 shutdown_connections 2023-09-28T00:16:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.608+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/768485943 wait complete. 2023-09-28T00:16:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.609+0000 7fcbd9bb8700 1 Processor -- start 2023-09-28T00:16:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.609+0000 7fcbd9bb8700 1 -- start start 2023-09-28T00:16:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd9bb8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd4159500 0x7fcbd414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd9bb8700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbd41598d0 0x7fcbd4151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd9bb8700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbd415d8e0 0x7fcbd41511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd9bb8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd414d080 con 0x7fcbd4159500 2023-09-28T00:16:54.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd9bb8700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd414d360 con 0x7fcbd415d8e0 2023-09-28T00:16:54.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd9bb8700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd414d640 con 0x7fcbd41598d0 2023-09-28T00:16:54.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd4159500 0x7fcbd414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd4159500 0x7fcbd414a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42430/0 (socket says 172.21.15.26:42430) 2023-09-28T00:16:54.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd37fe700 1 -- 172.21.15.26:0/1733585424 learned_addr learned my addr 172.21.15.26:0/1733585424 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:54.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd2ffd700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbd41598d0 0x7fcbd4151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd3fff700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbd415d8e0 0x7fcbd41511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd37fe700 1 -- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbd41598d0 msgr2=0x7fcbd4151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd37fe700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbd41598d0 0x7fcbd4151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd37fe700 1 -- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbd415d8e0 msgr2=0x7fcbd41511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:54.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd37fe700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbd415d8e0 0x7fcbd41511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:54.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd37fe700 1 -- 172.21.15.26:0/1733585424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8009420 con 0x7fcbd4159500 2023-09-28T00:16:54.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd37fe700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd4159500 0x7fcbd414a160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400c4e0 tx=0x7fcbc400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:54.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbbb7fe700 1 -- 172.21.15.26:0/1733585424 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4011590 con 0x7fcbd4159500 2023-09-28T00:16:54.616 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbbb7fe700 1 -- 172.21.15.26:0/1733585424 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcbc4011710 con 0x7fcbd4159500 2023-09-28T00:16:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd414d920 con 0x7fcbd4159500 2023-09-28T00:16:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbbb7fe700 1 -- 172.21.15.26:0/1733585424 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4011af0 con 0x7fcbd4159500 2023-09-28T00:16:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.610+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd414a6a0 con 0x7fcbd4159500 2023-09-28T00:16:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.611+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd414de40 con 0x7fcbd4159500 2023-09-28T00:16:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.612+0000 7fcbbb7fe700 1 -- 172.21.15.26:0/1733585424 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fcbc401b3b0 con 0x7fcbd4159500 2023-09-28T00:16:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.612+0000 7fcbbb7fe700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fcbc0067330 0x7fcbc00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.612+0000 7fcbbb7fe700 1 -- 172.21.15.26:0/1733585424 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fcbc4083ff0 con 0x7fcbd4159500 2023-09-28T00:16:54.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.612+0000 7fcbd2ffd700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fcbc0067330 0x7fcbc00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:54.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.613+0000 7fcbd2ffd700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fcbc0067330 0x7fcbc00697e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80093f0 tx=0x7fcbc80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:54.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.616+0000 7fcbbb7fe700 1 -- 172.21.15.26:0/1733585424 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fcbc4050f30 con 0x7fcbd4159500 2023-09-28T00:16:54.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:54.856+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcbd4064050 con 0x7fcbd4159500 2023-09-28T00:16:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.831+0000 7fcbbb7fe700 1 -- 172.21.15.26:0/1733585424 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcbc4017090 con 0x7fcbd4159500 2023-09-28T00:16:55.834 INFO:tasks.ceph.mds.d.smithi190.stderr: -1844> 2023-09-28T00:15:35.056+0000 7f3c28989700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-28T00:16:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.833+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fcbc0067330 msgr2=0x7fcbc00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.833+0000 7fcbd9bb8700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fcbc0067330 0x7fcbc00697e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80093f0 tx=0x7fcbc80091a0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.833+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd4159500 msgr2=0x7fcbd414a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.833+0000 7fcbd9bb8700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd4159500 0x7fcbd414a160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400c4e0 tx=0x7fcbc400c7f0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.834+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 shutdown_connections 2023-09-28T00:16:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.834+0000 7fcbd9bb8700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fcbc0067330 0x7fcbc00697e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.834+0000 7fcbd9bb8700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcbd415d8e0 0x7fcbd41511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.834+0000 7fcbd9bb8700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbd4159500 0x7fcbd414a160 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.834+0000 7fcbd9bb8700 1 --2- 172.21.15.26:0/1733585424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcbd41598d0 0x7fcbd4151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.834+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 >> 172.21.15.26:0/1733585424 conn(0x7fcbd4067630 msgr2=0x7fcbd40b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.834+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 shutdown_connections 2023-09-28T00:16:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.834+0000 7fcbd9bb8700 1 -- 172.21.15.26:0/1733585424 wait complete. 2023-09-28T00:16:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-28T00:16:55.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-28T00:16:55.858 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2023-09-28T00:16:55.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.975+0000 7effe9717700 1 Processor -- start 2023-09-28T00:16:55.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.975+0000 7effe9717700 1 -- start start 2023-09-28T00:16:55.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.976+0000 7effe9717700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effe4159500 0x7effe41598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:55.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.976+0000 7effe9717700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe40b1110 con 0x7effe40b3fd0 2023-09-28T00:16:55.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.976+0000 7effe9717700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe40b13b0 con 0x7effe415dab0 2023-09-28T00:16:55.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.976+0000 7effe9717700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe40b1690 con 0x7effe4159500 2023-09-28T00:16:55.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.976+0000 7effe2ffd700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7effe4159500 0x7effe41598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:55.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.976+0000 7effe27fc700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7effe40b3fd0 0x7effe415d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35656/0 (socket says 172.21.15.26:35656) 2023-09-28T00:16:55.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.976+0000 7effe27fc700 1 -- 172.21.15.26:0/1952062853 learned_addr learned my addr 172.21.15.26:0/1952062853 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:16:55.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe2ffd700 1 -- 172.21.15.26:0/1952062853 >> v1:172.21.15.190:6789/0 conn(0x7effe415dab0 legacy=0x7effe40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:55.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe2ffd700 1 -- 172.21.15.26:0/1952062853 >> v1:172.21.15.26:6789/0 conn(0x7effe40b3fd0 legacy=0x7effe415d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:55.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe1ffb700 1 -- 172.21.15.26:0/1952062853 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324695338 0 0) 0x7effe40b1110 con 0x7effe40b3fd0 2023-09-28T00:16:55.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe2ffd700 1 -- 172.21.15.26:0/1952062853 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe40b1970 con 0x7effe4159500 2023-09-28T00:16:55.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe2ffd700 1 --2- 172.21.15.26:0/1952062853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe4159500 0x7effe41598d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7effdc0098e0 tx=0x7effdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389622532ef763fb server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:55.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe1ffb700 1 -- 172.21.15.26:0/1952062853 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc009e80 con 0x7effe4159500 2023-09-28T00:16:55.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe1ffb700 1 -- 172.21.15.26:0/1952062853 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7effdc00b820 con 0x7effe4159500 2023-09-28T00:16:55.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe1ffb700 1 -- 172.21.15.26:0/1952062853 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc00bbc0 con 0x7effe4159500 2023-09-28T00:16:55.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe9717700 1 -- 172.21.15.26:0/1952062853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe4159500 msgr2=0x7effe41598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:55.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe9717700 1 --2- 172.21.15.26:0/1952062853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe4159500 0x7effe41598d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7effdc0098e0 tx=0x7effdc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe9717700 1 -- 172.21.15.26:0/1952062853 shutdown_connections 2023-09-28T00:16:55.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.977+0000 7effe9717700 1 --2- 172.21.15.26:0/1952062853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe4159500 0x7effe41598d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.978+0000 7effe9717700 1 -- 172.21.15.26:0/1952062853 >> 172.21.15.26:0/1952062853 conn(0x7effe4067630 msgr2=0x7effe4069a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:55.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.978+0000 7effe9717700 1 -- 172.21.15.26:0/1952062853 shutdown_connections 2023-09-28T00:16:55.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.978+0000 7effe9717700 1 -- 172.21.15.26:0/1952062853 wait complete. 2023-09-28T00:16:55.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.979+0000 7effe9717700 1 Processor -- start 2023-09-28T00:16:55.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.979+0000 7effe9717700 1 -- start start 2023-09-28T00:16:55.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe9717700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effe40b3fd0 0x7effe415bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:55.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe9717700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effe4159500 0x7effe41507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:55.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe9717700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe415dab0 0x7effe414c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:55.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe9717700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe415ce00 con 0x7effe415dab0 2023-09-28T00:16:55.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe9717700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe4150ce0 con 0x7effe4159500 2023-09-28T00:16:55.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe9717700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe4152220 con 0x7effe40b3fd0 2023-09-28T00:16:55.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe415dab0 0x7effe414c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:55.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe37fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe415dab0 0x7effe414c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42444/0 (socket says 172.21.15.26:42444) 2023-09-28T00:16:55.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe37fe700 1 -- 172.21.15.26:0/875198971 learned_addr learned my addr 172.21.15.26:0/875198971 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:55.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe27fc700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effe4159500 0x7effe41507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:55.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe2ffd700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effe40b3fd0 0x7effe415bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:55.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe37fe700 1 -- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effe40b3fd0 msgr2=0x7effe415bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:55.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe37fe700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effe40b3fd0 0x7effe415bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe37fe700 1 -- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effe4159500 msgr2=0x7effe41507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:55.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe37fe700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effe4159500 0x7effe41507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe37fe700 1 -- 172.21.15.26:0/875198971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc009420 con 0x7effe415dab0 2023-09-28T00:16:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe37fe700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe415dab0 0x7effe414c7e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effd400c890 tx=0x7effd40026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effdaffd700 1 -- 172.21.15.26:0/875198971 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4012630 con 0x7effe415dab0 2023-09-28T00:16:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effdaffd700 1 -- 172.21.15.26:0/875198971 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7effd40127b0 con 0x7effe415dab0 2023-09-28T00:16:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe415c280 con 0x7effe415dab0 2023-09-28T00:16:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effdaffd700 1 -- 172.21.15.26:0/875198971 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4012b90 con 0x7effe415dab0 2023-09-28T00:16:55.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.980+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe415c610 con 0x7effe415dab0 2023-09-28T00:16:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.981+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe4064050 con 0x7effe415dab0 2023-09-28T00:16:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.982+0000 7effdaffd700 1 -- 172.21.15.26:0/875198971 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7effd401b400 con 0x7effe415dab0 2023-09-28T00:16:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.982+0000 7effdaffd700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7effc4067330 0x7effc40697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.982+0000 7effdaffd700 1 -- 172.21.15.26:0/875198971 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6202+0+0 (secure 0 0 0) 0x7effd4084ef0 con 0x7effe415dab0 2023-09-28T00:16:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.982+0000 7effe2ffd700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7effc4067330 0x7effc40697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:55.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.983+0000 7effe2ffd700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7effc4067330 0x7effc40697e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7effdc0030c0 tx=0x7effdc0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:55.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:55.986+0000 7effdaffd700 1 -- 172.21.15.26:0/875198971 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7effd4051de0 con 0x7effe415dab0 2023-09-28T00:16:56.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.228+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7effe415cbe0 con 0x7effe415dab0 2023-09-28T00:16:56.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.861+0000 7effdaffd700 1 -- 172.21.15.26:0/875198971 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7effd40160a0 con 0x7effe415dab0 2023-09-28T00:16:56.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7effc4067330 msgr2=0x7effc40697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:56.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7effc4067330 0x7effc40697e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7effdc0030c0 tx=0x7effdc0091a0 comp rx=0 tx=0).stop 2023-09-28T00:16:56.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe415dab0 msgr2=0x7effe414c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:56.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe415dab0 0x7effe414c7e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7effd400c890 tx=0x7effd40026a0 comp rx=0 tx=0).stop 2023-09-28T00:16:56.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 shutdown_connections 2023-09-28T00:16:56.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7effc4067330 0x7effc40697e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:56.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7effe40b3fd0 0x7effe415bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:56.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effe415dab0 0x7effe414c7e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:56.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 --2- 172.21.15.26:0/875198971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7effe4159500 0x7effe41507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:56.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 >> 172.21.15.26:0/875198971 conn(0x7effe4067630 msgr2=0x7effe414f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:56.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 shutdown_connections 2023-09-28T00:16:56.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:56.864+0000 7effe9717700 1 -- 172.21.15.26:0/875198971 wait complete. 2023-09-28T00:16:56.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-28T00:16:57.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.003+0000 7fb3ea379700 1 Processor -- start 2023-09-28T00:16:57.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.003+0000 7fb3ea379700 1 -- start start 2023-09-28T00:16:57.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.003+0000 7fb3ea379700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb3e40ccbe0 0x7fb3e40b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:57.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.003+0000 7fb3ea379700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3e40d0f00 0x7fb3e40ce270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:57.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3ea379700 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e40cbed0 con 0x7fb3e40b55b0 2023-09-28T00:16:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3ea379700 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e4159d40 con 0x7fb3e40d0f00 2023-09-28T00:16:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3ea379700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e40cc750 con 0x7fb3e40ccbe0 2023-09-28T00:16:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e8916700 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb3e40d0f00 0x7fb3e40ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e3fff700 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb3e40b55b0 0x7fb3e40cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:35666/0 (socket says 172.21.15.26:35666) 2023-09-28T00:16:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e3fff700 1 -- 172.21.15.26:0/1692303438 learned_addr learned my addr 172.21.15.26:0/1692303438 (peer_addr_for_me v1:172.21.15.26:0/0) 2023-09-28T00:16:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e37fe700 1 --2- 172.21.15.26:0/1692303438 >> v2:172.21.15.190:3300/0 conn(0x7fb3e40ccbe0 0x7fb3e40b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:57.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e8916700 1 -- 172.21.15.26:0/1692303438 >> v2:172.21.15.190:3300/0 conn(0x7fb3e40ccbe0 msgr2=0x7fb3e40b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e8916700 1 --2- 172.21.15.26:0/1692303438 >> v2:172.21.15.190:3300/0 conn(0x7fb3e40ccbe0 0x7fb3e40b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e8916700 1 -- 172.21.15.26:0/1692303438 >> v1:172.21.15.26:6789/0 conn(0x7fb3e40b55b0 legacy=0x7fb3e40cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e8916700 1 -- 172.21.15.26:0/1692303438 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e40cd050 con 0x7fb3e40d0f00 2023-09-28T00:16:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e2ffd700 1 -- 172.21.15.26:0/1692303438 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658741401 0 0) 0x7fb3e40cbed0 con 0x7fb3e40b55b0 2023-09-28T00:16:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e8916700 1 --2- 172.21.15.26:0/1692303438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40d0f00 0x7fb3e40ce270 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cd220 tx=0x7fb3dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fd9d9c56f81601 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e2ffd700 1 -- 172.21.15.26:0/1692303438 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00e070 con 0x7fb3e40d0f00 2023-09-28T00:16:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e2ffd700 1 -- 172.21.15.26:0/1692303438 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb3dc00bc30 con 0x7fb3e40d0f00 2023-09-28T00:16:57.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.004+0000 7fb3e2ffd700 1 -- 172.21.15.26:0/1692303438 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc012430 con 0x7fb3e40d0f00 2023-09-28T00:16:57.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.005+0000 7fb3ea379700 1 -- 172.21.15.26:0/1692303438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40d0f00 msgr2=0x7fb3e40ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:57.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.005+0000 7fb3ea379700 1 --2- 172.21.15.26:0/1692303438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40d0f00 0x7fb3e40ce270 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40cd220 tx=0x7fb3dc009780 comp rx=0 tx=0).stop 2023-09-28T00:16:57.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.005+0000 7fb3ea379700 1 -- 172.21.15.26:0/1692303438 shutdown_connections 2023-09-28T00:16:57.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.005+0000 7fb3ea379700 1 --2- 172.21.15.26:0/1692303438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40d0f00 0x7fb3e40ce270 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:57.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.005+0000 7fb3ea379700 1 --2- 172.21.15.26:0/1692303438 >> v2:172.21.15.190:3300/0 conn(0x7fb3e40ccbe0 0x7fb3e40b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:57.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.005+0000 7fb3ea379700 1 -- 172.21.15.26:0/1692303438 >> 172.21.15.26:0/1692303438 conn(0x7fb3e408a050 msgr2=0x7fb3e4099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:57.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.005+0000 7fb3ea379700 1 -- 172.21.15.26:0/1692303438 shutdown_connections 2023-09-28T00:16:57.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.005+0000 7fb3ea379700 1 -- 172.21.15.26:0/1692303438 wait complete. 2023-09-28T00:16:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.006+0000 7fb3ea379700 1 Processor -- start 2023-09-28T00:16:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.006+0000 7fb3ea379700 1 -- start start 2023-09-28T00:16:57.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3ea379700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40b55b0 0x7fb3e4069270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3ea379700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e40ccbe0 0x7fb3e4145830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3ea379700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e40d0f00 0x7fb3e4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3ea379700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40b2c20 con 0x7fb3e40b55b0 2023-09-28T00:16:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3ea379700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40681d0 con 0x7fb3e40d0f00 2023-09-28T00:16:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3ea379700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40684b0 con 0x7fb3e40ccbe0 2023-09-28T00:16:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40b55b0 0x7fb3e4069270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:57.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40b55b0 0x7fb3e4069270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42464/0 (socket says 172.21.15.26:42464) 2023-09-28T00:16:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e3fff700 1 -- 172.21.15.26:0/2631479205 learned_addr learned my addr 172.21.15.26:0/2631479205 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e37fe700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e40ccbe0 0x7fb3e4145830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e8916700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e40d0f00 0x7fb3e4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e3fff700 1 -- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e40ccbe0 msgr2=0x7fb3e4145830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e3fff700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e40ccbe0 0x7fb3e4145830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e3fff700 1 -- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e40d0f00 msgr2=0x7fb3e4067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e3fff700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e40d0f00 0x7fb3e4067630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:57.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.007+0000 7fb3e3fff700 1 -- 172.21.15.26:0/2631479205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc009a20 con 0x7fb3e40b55b0 2023-09-28T00:16:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.008+0000 7fb3e3fff700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40b55b0 0x7fb3e4069270 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400c590 tx=0x7fb3d4007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.008+0000 7fb3cbfff700 1 -- 172.21.15.26:0/2631479205 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40072e0 con 0x7fb3e40b55b0 2023-09-28T00:16:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.008+0000 7fb3cbfff700 1 -- 172.21.15.26:0/2631479205 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb3d4007480 con 0x7fb3e40b55b0 2023-09-28T00:16:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.008+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e4068790 con 0x7fb3e40b55b0 2023-09-28T00:16:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.008+0000 7fb3cbfff700 1 -- 172.21.15.26:0/2631479205 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d40057f0 con 0x7fb3e40b55b0 2023-09-28T00:16:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.008+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e4068d50 con 0x7fb3e40b55b0 2023-09-28T00:16:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.009+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e40d0ac0 con 0x7fb3e40b55b0 2023-09-28T00:16:57.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.009+0000 7fb3cbfff700 1 -- 172.21.15.26:0/2631479205 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7fb3d4005ba0 con 0x7fb3e40b55b0 2023-09-28T00:16:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.010+0000 7fb3cbfff700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb3d0067330 0x7fb3d00697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.010+0000 7fb3cbfff700 1 -- 172.21.15.26:0/2631479205 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6202+0+0 (secure 0 0 0) 0x7fb3d4084030 con 0x7fb3e40b55b0 2023-09-28T00:16:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.010+0000 7fb3e37fe700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb3d0067330 0x7fb3d00697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.010+0000 7fb3e37fe700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb3d0067330 0x7fb3d00697e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40ca4f0 tx=0x7fb3d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:57.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.014+0000 7fb3cbfff700 1 -- 172.21.15.26:0/2631479205 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7fb3d404b570 con 0x7fb3e40b55b0 2023-09-28T00:16:57.208 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.207+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3e40717c0 con 0x7fb3e40b55b0 2023-09-28T00:16:57.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.868+0000 7fb3cbfff700 1 -- 172.21.15.26:0/2631479205 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb3d4050fd0 con 0x7fb3e40b55b0 2023-09-28T00:16:57.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb3d0067330 msgr2=0x7fb3d00697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:57.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb3d0067330 0x7fb3d00697e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb3e40ca4f0 tx=0x7fb3d8008040 comp rx=0 tx=0).stop 2023-09-28T00:16:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40b55b0 msgr2=0x7fb3e4069270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40b55b0 0x7fb3e4069270 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb3d400c590 tx=0x7fb3d4007e80 comp rx=0 tx=0).stop 2023-09-28T00:16:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 shutdown_connections 2023-09-28T00:16:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7fb3d0067330 0x7fb3d00697e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3e40d0f00 0x7fb3e4067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3e40b55b0 0x7fb3e4069270 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:57.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 --2- 172.21.15.26:0/2631479205 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3e40ccbe0 0x7fb3e4145830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:57.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 >> 172.21.15.26:0/2631479205 conn(0x7fb3e408a050 msgr2=0x7fb3e40c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:57.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 shutdown_connections 2023-09-28T00:16:57.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:57.871+0000 7fb3ea379700 1 -- 172.21.15.26:0/2631479205 wait complete. 2023-09-28T00:16:57.874 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-09-28T00:16:57.885 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-28T00:16:58.013 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.012+0000 7f54275e5700 1 Processor -- start 2023-09-28T00:16:58.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.012+0000 7f54275e5700 1 -- start start 2023-09-28T00:16:58.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.013+0000 7f54275e5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420159d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:58.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.013+0000 7f54275e5700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54200695e0 0x7f54200aa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:58.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.013+0000 7f54275e5700 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54200a9de0 con 0x7f542015a240 2023-09-28T00:16:58.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.013+0000 7f54275e5700 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542015a7b0 con 0x7f54200695e0 2023-09-28T00:16:58.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.013+0000 7f54275e5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542015aa90 con 0x7f54200cb6b0 2023-09-28T00:16:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.013+0000 7f5425b82700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54200695e0 0x7f54200aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.013+0000 7f5425381700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f5425381700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:50900/0 (socket says 172.21.15.26:50900) 2023-09-28T00:16:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f5425b82700 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f54200695e0 0x7f54200aa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:46862/0 (socket says 172.21.15.26:46862) 2023-09-28T00:16:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f5425381700 1 -- 172.21.15.26:0/521798385 learned_addr learned my addr 172.21.15.26:0/521798385 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f5424b80700 1 --1- 172.21.15.26:0/521798385 >> v1:172.21.15.190:6789/0 conn(0x7f542015a240 0x7f5420068ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:46004/0 (socket says 172.21.15.26:46004) 2023-09-28T00:16:58.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f5425381700 1 -- 172.21.15.26:0/521798385 >> v2:172.21.15.190:3300/0 conn(0x7f54200695e0 msgr2=0x7f54200aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-28T00:16:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f5425381700 1 --2- 172.21.15.26:0/521798385 >> v2:172.21.15.190:3300/0 conn(0x7f54200695e0 0x7f54200aa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f5425381700 1 -- 172.21.15.26:0/521798385 >> v1:172.21.15.190:6789/0 conn(0x7f542015a240 legacy=0x7f5420068ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f5425381700 1 -- 172.21.15.26:0/521798385 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54200a9a70 con 0x7f54200cb6b0 2023-09-28T00:16:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f5425381700 1 --2- 172.21.15.26:0/521798385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420159d00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5418009f20 tx=0x7f5418009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7764d4d01c0db6d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f541ffff700 1 -- 172.21.15.26:0/521798385 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541800e070 con 0x7f54200cb6b0 2023-09-28T00:16:58.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f541ffff700 1 -- 172.21.15.26:0/521798385 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f541800b9d0 con 0x7f54200cb6b0 2023-09-28T00:16:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.014+0000 7f541ffff700 1 -- 172.21.15.26:0/521798385 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54180092e0 con 0x7f54200cb6b0 2023-09-28T00:16:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.015+0000 7f54275e5700 1 -- 172.21.15.26:0/521798385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 msgr2=0x7f5420159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.015+0000 7f54275e5700 1 --2- 172.21.15.26:0/521798385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420159d00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5418009f20 tx=0x7f5418009840 comp rx=0 tx=0).stop 2023-09-28T00:16:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.015+0000 7f54275e5700 1 -- 172.21.15.26:0/521798385 shutdown_connections 2023-09-28T00:16:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.015+0000 7f54275e5700 1 --2- 172.21.15.26:0/521798385 >> v2:172.21.15.190:3300/0 conn(0x7f54200695e0 0x7f54200aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.015+0000 7f54275e5700 1 --2- 172.21.15.26:0/521798385 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420159d00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.015+0000 7f54275e5700 1 -- 172.21.15.26:0/521798385 >> 172.21.15.26:0/521798385 conn(0x7f54200ca070 msgr2=0x7f542006df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:58.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.015+0000 7f54275e5700 1 -- 172.21.15.26:0/521798385 shutdown_connections 2023-09-28T00:16:58.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.015+0000 7f54275e5700 1 -- 172.21.15.26:0/521798385 wait complete. 2023-09-28T00:16:58.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.016+0000 7f54275e5700 1 Processor -- start 2023-09-28T00:16:58.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.016+0000 7f54275e5700 1 -- start start 2023-09-28T00:16:58.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f54275e5700 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54200695e0 0x7f542016a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:58.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f54275e5700 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:58.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f54275e5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542015a240 0x7f5420068680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:58.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f54275e5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542016ac70 con 0x7f542015a240 2023-09-28T00:16:58.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f54275e5700 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5420156ce0 con 0x7f54200695e0 2023-09-28T00:16:58.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f54275e5700 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5420156fc0 con 0x7f54200cb6b0 2023-09-28T00:16:58.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5425b82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542015a240 0x7f5420068680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:58.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5425b82700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542015a240 0x7f5420068680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42480/0 (socket says 172.21.15.26:42480) 2023-09-28T00:16:58.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5425b82700 1 -- 172.21.15.26:0/4286170793 learned_addr learned my addr 172.21.15.26:0/4286170793 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-09-28T00:16:58.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5425381700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54200695e0 0x7f542016a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:58.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5424b80700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5425b82700 1 -- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 msgr2=0x7f5420155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5425b82700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5425b82700 1 -- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54200695e0 msgr2=0x7f542016a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5425b82700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54200695e0 0x7f542016a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.017+0000 7f5425b82700 1 -- 172.21.15.26:0/4286170793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418009ae0 con 0x7f542015a240 2023-09-28T00:16:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.018+0000 7f5425b82700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542015a240 0x7f5420068680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f541000e8d0 tx=0x7f54100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.018+0000 7f541d7fa700 1 -- 172.21.15.26:0/4286170793 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410013680 con 0x7f542015a240 2023-09-28T00:16:58.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.018+0000 7f541d7fa700 1 -- 172.21.15.26:0/4286170793 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f54100137e0 con 0x7f542015a240 2023-09-28T00:16:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.018+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54201572a0 con 0x7f542015a240 2023-09-28T00:16:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.018+0000 7f541d7fa700 1 -- 172.21.15.26:0/4286170793 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410013bc0 con 0x7f542015a240 2023-09-28T00:16:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.018+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5420157860 con 0x7f542015a240 2023-09-28T00:16:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.019+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5420157a80 con 0x7f542015a240 2023-09-28T00:16:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.019+0000 7f541d7fa700 1 -- 172.21.15.26:0/4286170793 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 85040+0+0 (secure 0 0 0) 0x7f54100123d0 con 0x7f542015a240 2023-09-28T00:16:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.020+0000 7f541d7fa700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f540c067330 0x7f540c0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-28T00:16:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.020+0000 7f541d7fa700 1 -- 172.21.15.26:0/4286170793 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f5410084b20 con 0x7f542015a240 2023-09-28T00:16:58.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.020+0000 7f5425381700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f540c067330 0x7f540c0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-28T00:16:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.020+0000 7f5425381700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f540c067330 0x7f540c0697e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5418009f20 tx=0x7f5418009840 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-28T00:16:58.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.024+0000 7f541d7fa700 1 -- 172.21.15.26:0/4286170793 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173397 (secure 0 0 0) 0x7f5410051b40 con 0x7f542015a240 2023-09-28T00:16:58.219 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.218+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54200717c0 con 0x7f542015a240 2023-09-28T00:16:58.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.872+0000 7f541d7fa700 1 -- 172.21.15.26:0/4286170793 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f54100170d0 con 0x7f542015a240 2023-09-28T00:16:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f540c067330 msgr2=0x7f540c0697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f540c067330 0x7f540c0697e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5418009f20 tx=0x7f5418009840 comp rx=0 tx=0).stop 2023-09-28T00:16:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542015a240 msgr2=0x7f5420068680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-28T00:16:58.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542015a240 0x7f5420068680 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f541000e8d0 tx=0x7f54100091a0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 shutdown_connections 2023-09-28T00:16:58.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:6832/89869,v1:172.21.15.190:6833/89869] conn(0x7f540c067330 0x7f540c0697e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f542015a240 0x7f5420068680 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f54200695e0 0x7f542016a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 --2- 172.21.15.26:0/4286170793 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f54200cb6b0 0x7f5420155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-28T00:16:58.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 >> 172.21.15.26:0/4286170793 conn(0x7f54200ca070 msgr2=0x7f5420152890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-28T00:16:58.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 shutdown_connections 2023-09-28T00:16:58.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-09-28T00:16:58.876+0000 7f54275e5700 1 -- 172.21.15.26:0/4286170793 wait complete. 2023-09-28T00:16:58.879 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-09-28T00:16:58.893 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-28T00:16:58.894 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-28T00:16:58.894 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:58.903 INFO:tasks.ceph.mds.a:Stopped 2023-09-28T00:16:58.903 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-28T00:16:58.904 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:58.954 INFO:tasks.ceph.mds.c:Stopped 2023-09-28T00:16:58.954 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-28T00:16:58.954 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:58.965 INFO:tasks.ceph.mds.b:Stopped 2023-09-28T00:16:58.966 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-09-28T00:16:58.966 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.016 INFO:tasks.ceph.mds.d:Stopped 2023-09-28T00:16:59.017 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-28T00:16:59.017 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-28T00:16:59.017 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.047 INFO:tasks.ceph.osd.0:Stopped 2023-09-28T00:16:59.047 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-28T00:16:59.047 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.119 INFO:tasks.ceph.osd.1:Stopped 2023-09-28T00:16:59.119 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-28T00:16:59.119 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.183 INFO:tasks.ceph.osd.2:Stopped 2023-09-28T00:16:59.184 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-28T00:16:59.184 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.249 INFO:tasks.ceph.osd.3:Stopped 2023-09-28T00:16:59.249 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-09-28T00:16:59.249 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.299 INFO:tasks.ceph.osd.4:Stopped 2023-09-28T00:16:59.300 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-09-28T00:16:59.300 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.340 INFO:tasks.ceph.osd.5:Stopped 2023-09-28T00:16:59.341 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-09-28T00:16:59.341 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.377 INFO:tasks.ceph.osd.6:Stopped 2023-09-28T00:16:59.377 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-09-28T00:16:59.377 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.451 INFO:tasks.ceph.osd.7:Stopped 2023-09-28T00:16:59.452 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-28T00:16:59.452 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-28T00:16:59.452 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.475 INFO:tasks.ceph.mgr.y:Stopped 2023-09-28T00:16:59.475 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-28T00:16:59.475 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.518 INFO:tasks.ceph.mgr.x:Stopped 2023-09-28T00:16:59.518 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-28T00:16:59.519 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-28T00:16:59.519 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.529 INFO:tasks.ceph.mon.a:Stopped 2023-09-28T00:16:59.529 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-28T00:16:59.529 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.569 INFO:tasks.ceph.mon.b:Stopped 2023-09-28T00:16:59.570 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-28T00:16:59.570 INFO:teuthology.orchestra.run:waiting for 300 2023-09-28T00:16:59.620 INFO:tasks.ceph.mon.c:Stopped 2023-09-28T00:16:59.620 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-28T00:16:59.620 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-09-28T00:16:59.650 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:16:59.651 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-28T00:16:59.879 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:16:59.879 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-28T00:16:59.994 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:16:59.995 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-28T00:17:00.082 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:17:00.082 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-28T00:17:00.148 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:17:00.149 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-09-28T00:17:00.344 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:17:00.344 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-09-28T00:17:00.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:17:00.398 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:17:00.446 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:17:00.446 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-09-28T00:17:00.512 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:17:00.512 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-09-28T00:17:00.584 INFO:tasks.ceph:Archiving mon data... 2023-09-28T00:17:00.585 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/data/mon.a.tgz 2023-09-28T00:17:00.585 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2023-09-28T00:17:00.601 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.PTOWM2tzSm 2023-09-28T00:17:00.602 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PTOWM2tzSm 2023-09-28T00:17:00.725 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.PTOWM2tzSm 2023-09-28T00:17:00.809 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.PTOWM2tzSm is 248KB 2023-09-28T00:17:00.904 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.PTOWM2tzSm 2023-09-28T00:17:00.919 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/data/mon.b.tgz 2023-09-28T00:17:00.919 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-09-28T00:17:00.935 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.iqSCoNQg98 2023-09-28T00:17:00.935 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.iqSCoNQg98 2023-09-28T00:17:01.075 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.iqSCoNQg98 2023-09-28T00:17:01.157 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.iqSCoNQg98 is 333KB 2023-09-28T00:17:01.251 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.iqSCoNQg98 2023-09-28T00:17:01.266 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/data/mon.c.tgz 2023-09-28T00:17:01.266 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2023-09-28T00:17:01.320 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.qKkagHKFtO 2023-09-28T00:17:01.320 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.qKkagHKFtO 2023-09-28T00:17:01.442 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.qKkagHKFtO 2023-09-28T00:17:01.522 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.qKkagHKFtO is 333KB 2023-09-28T00:17:01.587 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.qKkagHKFtO 2023-09-28T00:17:01.601 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-28T00:17:01.601 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-28T00:17:01.603 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-28T00:17:01.664 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-28T00:17:01.664 DEBUG:teuthology.orchestra.run.smithi026:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-28T00:17:01.669 DEBUG:teuthology.orchestra.run.smithi190:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-28T00:17:01.693 INFO:teuthology.orchestra.run.smithi026.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-28T00:17:01.728 INFO:teuthology.orchestra.run.smithi190.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-28T00:17:01.733 INFO:tasks.ceph:Archiving crash dumps... 2023-09-28T00:17:01.735 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/remote/smithi026/crash 2023-09-28T00:17:01.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-28T00:17:01.764 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/remote/smithi190/crash 2023-09-28T00:17:01.765 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-28T00:17:01.797 INFO:tasks.ceph:Shutting down logrotate 2023-09-28T00:17:01.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:17:01.808 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-28T00:17:01.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-28T00:17:01.913 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-28T00:17:01.937 INFO:tasks.ceph:Compressing logs... 2023-09-28T00:17:01.937 DEBUG:teuthology.orchestra.run.smithi026:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T00:17:01.955 DEBUG:teuthology.orchestra.run.smithi190:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T00:17:02.557 INFO:tasks.ceph:Archiving logs... 2023-09-28T00:17:02.557 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/remote/smithi026/log 2023-09-28T00:17:02.558 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-28T00:17:02.721 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/remote/smithi190/log 2023-09-28T00:17:02.723 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-28T00:17:02.824 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-28T00:17:02.838 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-28T00:17:02.838 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-28T00:17:02.841 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-28T00:17:02.923 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-28T00:17:02.932 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-28T00:17:02.933 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T00:17:02.935 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-28T00:17:02.946 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2023-09-28T00:17:02.949 INFO:teuthology.orchestra.run.smithi190.stderr:bash: ntpq: command not found 2023-09-28T00:17:02.949 INFO:teuthology.orchestra.run.smithi026.stdout:210 Number of sources = 4 2023-09-28T00:17:02.949 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T00:17:02.949 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2023-09-28T00:17:02.950 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 -475us[ -475us] +/- 72ms 2023-09-28T00:17:02.950 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -1216us[-1223us] +/- 65ms 2023-09-28T00:17:02.950 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 +2036us[+2036us] +/- 80ms 2023-09-28T00:17:02.950 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:17:02.952 INFO:teuthology.orchestra.run.smithi190.stdout:210 Number of sources = 4 2023-09-28T00:17:02.952 INFO:teuthology.orchestra.run.smithi190.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-28T00:17:02.952 INFO:teuthology.orchestra.run.smithi190.stdout:=============================================================================== 2023-09-28T00:17:02.952 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 12 -471us[ -471us] +/- 72ms 2023-09-28T00:17:02.953 INFO:teuthology.orchestra.run.smithi190.stdout:^* hv02.front.sepia.ceph.com 3 6 377 12 -1219us[-1224us] +/- 65ms 2023-09-28T00:17:02.953 INFO:teuthology.orchestra.run.smithi190.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +2041us[+2036us] +/- 80ms 2023-09-28T00:17:02.953 INFO:teuthology.orchestra.run.smithi190.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-28T00:17:02.953 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-28T00:17:02.963 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-28T00:17:02.963 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-28T00:17:02.974 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-28T00:17:03.084 DEBUG:teuthology.orchestra.run.smithi190:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-28T00:17:03.171 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T00:17:03.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:17:03.202 DEBUG:teuthology.orchestra.run.smithi190:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-28T00:17:03.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:17:03.231 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-28T00:17:03.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-28T00:17:03.253 INFO:teuthology.task.internal:Duration was 773.291060 seconds 2023-09-28T00:17:03.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-28T00:17:03.264 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-28T00:17:03.264 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-28T00:17:03.267 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-28T00:17:03.310 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T00:17:03.315 INFO:teuthology.orchestra.run.smithi190.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-28T00:17:03.605 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-28T00:17:03.605 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2023-09-28T00:17:03.606 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-28T00:17:03.625 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2023-09-28T00:17:03.625 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-28T00:17:03.664 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-28T00:17:03.665 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T00:17:03.667 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-28T00:17:03.742 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-28T00:17:03.742 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-28T00:17:03.746 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-28T00:17:03.851 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-28T00:17:03.864 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-28T00:17:03.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-28T00:17:03.889 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-28T00:17:03.914 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-28T00:17:03.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-28T00:17:03.932 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-28T00:17:03.954 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2023-09-28T00:17:03.977 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2023-09-28T00:17:03.990 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-28T00:17:04.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:17:04.022 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-28T00:17:04.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:17:04.045 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-28T00:17:04.056 INFO:teuthology.task.internal:Transferring archived files... 2023-09-28T00:17:04.057 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/remote/smithi026 2023-09-28T00:17:04.057 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-28T00:17:04.099 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488/remote/smithi190 2023-09-28T00:17:04.099 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-28T00:17:04.133 INFO:teuthology.task.internal:Removing archive directory... 2023-09-28T00:17:04.133 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-28T00:17:04.135 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-28T00:17:04.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-28T00:17:04.194 INFO:teuthology.task.internal:Not uploading archives. 2023-09-28T00:17:04.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-28T00:17:04.206 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-28T00:17:04.207 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-28T00:17:04.210 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-28T00:17:04.221 INFO:teuthology.orchestra.run.smithi026.stdout: 262176 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 28 00:17 /home/ubuntu/cephtest 2023-09-28T00:17:04.222 INFO:teuthology.orchestra.run.smithi026.stdout: 393311 4 d--------- 2 ubuntu ubuntu 4096 Sep 28 00:15 /home/ubuntu/cephtest/mnt.0 2023-09-28T00:17:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2023-09-28T00:17:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-09-28T00:17:04.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-28T00:17:04.226 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-28T00:17:04.234 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-28T00:17:04.254 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-28T00:17:04.271 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi026 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-09-28T00:17:04.271 INFO:teuthology.nuke:Checking targets against current locks 2023-09-28T00:17:04.278 INFO:teuthology.orchestra.run.smithi190.stdout: 262172 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 28 00:17 /home/ubuntu/cephtest 2023-09-28T00:17:04.309 DEBUG:teuthology.nuke:shortname: smithi026 2023-09-28T00:17:04.310 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T00:17:04.337 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:57:08.713793', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH4KRPMJ/Sk11MpERihoceOIMKd4jJGx5Zrw9gESv7h2FwvJXafyFdjEIm3gt4mUYefLPc96cVEPeidgoBgp8jQ='} 2023-09-28T00:17:04.338 DEBUG:teuthology.nuke:shortname: smithi190 2023-09-28T00:17:04.338 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T00:17:04.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403488', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-27 23:57:08.715780', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGW6u61Bh3ClTs4VvujUDiEZq5QElDHaQmn5MJvzH/yWLqQwnjmzlUGNqnIrNpzXPhIntHN3gcG0zope9vy8rY8='} 2023-09-28T00:17:04.392 INFO:teuthology.orchestra.console.smithi026:Power off 2023-09-28T00:17:04.432 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T00:17:04.458 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-09-28T00:17:04.458 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:17:04.477 INFO:teuthology.orchestra.console.smithi190:Power off 2023-09-28T00:17:04.477 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T00:17:04.487 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-09-28T00:17:04.500 DEBUG:teuthology.orchestra.console.smithi190:power off output: Chassis Power Control: Down/Off 2023-09-28T00:17:04.500 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:17:04.523 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-09-28T00:17:08.488 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:17:08.524 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:17:08.598 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-09-28T00:17:08.635 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-09-28T00:17:12.601 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:17:12.636 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:17:12.710 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-09-28T00:17:12.744 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is on 2023-09-28T00:17:12.812 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-09-28T00:17:16.746 DEBUG:teuthology.orchestra.console.smithi190:pexpect command: ipmitool -H smithi190.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T00:17:16.855 DEBUG:teuthology.orchestra.console.smithi190:check power output: Chassis Power is off 2023-09-28T00:17:16.956 INFO:teuthology.orchestra.console.smithi190:Power off completed 2023-09-28T00:17:17.060 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} duration: 773.2910604476929 failure_reason: '' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=796a07e2640b4a498dc496114abb9f4f status: fail success: false 2023-09-28T00:17:17.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T00:17:17.140 INFO:teuthology.run:FAIL